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EDITORS •  PREFACE 


Spare  parts  demand  prediction  is  a  basic  logistics  problem,  and 
one  that  has  many  unresolved  facets.  The  problem *s  various  aspects 
have  been  under  study  at  RAND  and  elsewhere,  in  both  military  and  in¬ 
dustrial  environments.  But,  until  recently,  researchers  in  this  field 
had  never  come  together  to  discuss  mutual  problems  and  exchange  ideas. 

To  facilitate  this  exchange,  RATH)  sponsored  a  Demand  Prediction  Con¬ 
ference  at  Stanford  University  on  January  25  and  26,  1962.  The  main 
purpose  was  to  review  the  present  state-of-the-art  in  demand  prediction, 
and  delineate  possible  fruitful  areas  of  research. 

Eighteen  people,  representing  nine  military  and  civilian  organi¬ 
zations  in  all,  attended  the  Conference.  One  participant  from  each 
group  presented  some  results  of  their  work,  centering  the  discussion 
aroxmd  the  following  topics  and  questions: 

(1)  Demand  patterns  --  what  underlying  statistical  patterns  seem 
to  be  present  in  demand  histories? 

(2)  Prediction  techniques  --  what  methods  or  models  seem  to  yield 
the  best  predictions  from  historical  data  by  any  appropriate 
criteria? 

(3)  Measures  of  prediction  accuracy  --  what  criteria  should  be 
used  to  compare  techniques?  What  arguments  should  be  ad¬ 
vanced  for  and  against  the  introduction  of  explicit  models 
of  the  costs  of  over-  or  underestimates? 

(4)  Data  availability  --  to  what  extent  is  the  prediction  problem 
one  of  completeness  and  accuracy  of  data,  as  opposed,  for 
example,  to  choice  of  technique  and  measure  of  accuracy? 

(5)  Time  period  —  to  what  extent,  if  any,  are  the  predictions 
affected  by  the  period  of  time  used  as  the  experience  period 
or  as  the  prediction  period?  Alternatively,  do  we  predict 
better  for  those  items  which  experience  a  large  or  a  small 
number  of  demands, 

(6)  System-wide  versus  base-level  demand  prediction  --  are  any  of 
the  above  affected  by  this  distinction?  If  so,  how? 
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A  general  discussion  of  the  areas  in  which  further  research  might 
be  undertaken  followed  the  presentations*  To  focus  the  discussion,  the 
following  questions  were  advanced  to  the  group:  what  data  are  readily 
available  for  different  classes  of  items?  What  data  would  we  like  to 
have  for  prediction  purposes?  Can  the  data  processing  be  improved? 

Should  demand  patterns  be  investigated  in  greater  detail  applying,  for 
example,  the  techniques  used  in  analyzing  time  series  such  as  trend, 
etc'.?  Can  we  find  better  program  elements  on  which  to  base  predictions? 
Which  additional  prediction  techniques  are  likely  to  prove  fruitful? 

What  is  the  best  way  of  evaluating  the  accuracy  of  predictions?  How 
can  we  take  account  of  dynamic  factors  such  as  changes  in  policy,  item 
design,  T*  0*,  or  effects  of  inspections,  repair,  replacement  procedures, 
transportation  and  environmental  usage,  etc*?  What  theoretical  studies 
should  be  undertaken?  Have  we  reached  the  limits  of  prediction  accuracy 
with  which  logistics  systems  must  be  content  and  with  which  they  must 
live? 

.nlthough  the  Conference  represented  many  different  customer  and 
commodity  interests,  there  were  similarities  in  the  problems  and  find¬ 
ings*  All  of  the  participants  felt  that  open  discussion  was  helpful, 
and  would  do  much  to  improve  the  quality  of  the  conclusions  and  recommend¬ 
ations  research  groups  make  to  their  customers*  There  was  general  feel¬ 
ing  that  this  Conference  was  valuable  and  that  a  similar  one  should  be 
held  say  in  a  year  or  two,  with  perhaps  more  representation  from  industry* 

The  RAND  Corporation  would  like  to  thank  Stanford  University  for 
hosting  the  Conference.  And  our  special  thanks  go  to  Dr*  Harvey  M*  Wagner 
of  Stanford  for  handling  the  Conference  details* 
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SUMMARY 

These  Proceedings  include  all  the  papers  presented  at  the  Demand 
Prediction  Conference,  together  with  a  general  Conference  discussion 
by  Kenneth  J,  Arrow,  and  some  comments  on  possible  areas  of  future 
research  by  Bnil  Hamilton.  This  summary  indicates  briefly  the  contents 
of  each  paper. 

In  his  presentation,  Albert  Cahn  discusses  the  value  of  having 
better  demand  prediction  methods  in  the  following  situation.  Vhen 
planning  for  the  stockage  of  a  particular  line  item,  all  one  can  ever 
do  is  predict  that  the  expected  demand  will  lie  between  certain  limits. 
If  it  is  possible  to  narrow  these  limits,  then  on  the  basis  of  certain 
assumptions,  it  is  also  possible  to  determine  the  order  of  magnitude 
of  the  potential  savings  that  will  result.  He  illustrates  the  procedure 
with  an  example. 

Based  on  historical  data  for  the  components  of  the  Falcon  missile, 
and  a  sample  of  B-52  parts.  Max  Astrachan's  paper  reports  on  a  long¬ 
term  evaluation  of  seven  different  techniques  for  predicting  spare  parts 
demand.  The  object  of  the  study  was  to  determine  which  technique  is 
preferable  in  varying  sets  of  circumstances  from  both  a  performance  and 
a  cost  point  of  view.  The  tecliniques  examined  are  based  on  constant 
demand  rates  per  weapon-system  program  element  or  service-life  chara¬ 
cteristics.  One  is  the  issue-rate  technique  widely  used  in  the  Air 
Force  and  elsewhere,  another  is  the  actuarial  procedure  currently  uoed 
for  aircraft  engines  and  other  items. 
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Among  the  conclusions  th?t  came  out  of  the  study  were  the  following* 
No  one  technique  was  consistently  preferred  for  all  parts  and  all  time 
periods*  No  matter  what  statistical  technique  is  used,  there  will  still 
be  prediction  errors;  some  may  be  large*  This  suggests  that  the  fore¬ 
caster  must  use  whatever  knowledge  and  engineering  information  he  has  at 
his  disposal  in  an  attempt  to  reduce  these  errors*  Although  many  parts 
seemed  to  have  increasing  demand  rates  over  time,  it  was  impossible  to 
identify  any  entire  category  for  which  the  service-life  techniques  were 
preferred*  Finally,  there  was  very  little  apparent  improvement  in 
accuracy  of  the  techniques  as  the  experience  period  increased,  i*e*,  as 
the  parts  were  exposed  to  more  and  more  months  of  operation** 

Jules  Silver^  s  paper  describes  the  use  of  the  Gamma  distribution  to 
predict  demands*  His  group  undertook  this  study  to  explore  the  possi¬ 
bility  of  developing  a  relatively  inexpensive  technique,  for  parts  having 
service-life  ch  iracteristics,  that  would  yield  results  at  least  comparable 
in  accuracy  to  those  obtained  by  the  use  of  computationally  more  expensive 
procedures  such  as  the  actuarial  method* 

The  procedure  was  initially  tested  by  means  of  a  Monte  Carlo  model, 
generating  demands  from  a  "uniform”  time-to-f allure  distribution,  assum¬ 
ing:  (1)  that  12  months  of  data  were  available  on  xfhich  to  base  fore¬ 
casts,  '■^nd  (2)  that  18  months  of  data  were  available*  For  comparison, 
predictions  were  also  made  using  the  issue-rate  and  actuarial  methods* 


■^ax  Astrachan,  Bernice  B*  Brown,  and  J*  W.  Houghten,  A  ComDaratlve 
Study  of  Prediction  Techniques*  The  RAND  Corporation,  HH-2611-PR,  December, 
1^61  (limited  Distribution). 
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In  (l)  the  actuarial  method  did  poorly;  In  (2)  It  did  well.  The 
Issue-rate  technique  did  poorly  In  both  cases,  as  might  he  eacpected 
from  the  nature  of  the  distribution  generating  the  demands.  Ihe  Gemma 
method  was  beet  In  both  cases.  It  was  subsequently  applied  to  13^  Items, 
for  which  predictions  had  been  made  by  the  actxiarlal  technique.  Althouc^ 
the  distributions  appeared  to  very  quite  widely,  the  results  obtained  by 
the  two  methods  showed  differences  of  the  order  of  15  per  cent  or  less. 

In  his  paper,  Henry  Solomon  discusses  a  few  of  the  major  highlights 
of  demand  behavior  and  prediction  studies  done  for  the  Office  of  Naval 
Research  under  the  auspices  of  the  George  Washington  Ghlverslty's 
Logistic  Research  Project.  An  early  st\]dy  concerned  the  determination 
of  suitable  operational  variables.  Lack  of  demand  data  for  this  and 
other  studies  they  were  doing  led  to  the  Initiation  of  a  large-scale 
usage  data  collection  program  representing  usage  by  and  on  account  of 
65  ships.  Although  they  learned  a  great  deal  about  the  problems  of 
data  collection  and  processing,  results  of  use  of  these  data  In  the 
search  for  operational  variables  were  mostly  negative. 

Again,  a  stvidy  of  mechanical  and  electrical  parts  usage  by  and  on 
account  of  12  submarines  over  a  four-year  period  showed  no  significant 
relation  between  usage  and  the  operational  variables  enqiloyed.  This 
study  edso  shoved  that  the  demand  for  Items  was  extremely  low  and  sporadic, 
that  for  any  given  ship  the  range  of  Items  demanded  differed  significantly 
from  year  to  year,  and  that  there  was  very  little  comnonallty  of  Items 
demanded  among  the  vessels.  Most  liqportant,  the  study  showed  that 
approximately  75  per  cent  of  the  Items  In  the  population  (l.e..  Installed 
and  deemed  wearable),  were  not  demanded  at  all,  by  or  on  account  of  each 
ship  during  the  data  collection  period.  The  Iqplleatlon  of  these 
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results  for  stockage  policies  was  that  greater  en^hasls  should  he  given 
to  range  rather  than  depth  of  items.  Ihis  led  to  a  major  study  pertain¬ 
ing  to  the  military  essentiality  of  repeuLr  parts  to  help  determine  the 
range  of  stockage. 

The  vise  of  a  function  of  population  data  —  the  nimher  of  oppor¬ 
tunities  for  usage  of  an  item  —  yielded  premising  results.  In  part¬ 
icular,  the  square  root  of  the  peculation  size  in  one  of  their  studies 
turned  out  to  be  as  good  an  estimator  as  any  other  procedure  used  at 
that  time. 

Recently,  the  Project  has  vindertaken  a  research  program  pertaining 
to  the  logistics  system  for  the  Polaris  Weapon  System.  In  studying  the 
nature  of  the  distribution  of  demands  for  line  items,  it  was  found  that 
in  the  great  meijority  of  cases,  the  negative  binomial  distribution  could 
be  used.  This  distribution  has  some  interesting  properties  which  are 
currently  under  closer  examination  at  the  Project.  One  other  incortant 
point  seems  to  be  emerging  from  the  data  collection  program.  Based  on 
the  relatively  small  amount  of  data  received  thus  far,  >^le  demand  for 
line  items  is  very  low  and  sporadic,  the  bulk  of  the  items  used  pertain 
to  a  very  small  percentage  of  the  total  conconents  Installed. 

The  final  study  Solomon  describes  concerns  spare  parts  demand  for 
Naval  aircraft.  An  examination  and  analysis  of  the  data  yielded  results 
similar  to  those  obtained  for  Mr  Force  planes.  The  author  concludes  his 
paper  with  some  comaents  on  the  relationship  between  desMind  prediction 
and  inventory  models. 

Robert  Brown  briefly  svamarlzes  the  work  done  by  Arthur  D.  Little, 
Inc.,  for  the  Bureau  of  Sicplles  and  Accounts,  Navy  Department.  Be 
Identifies  and  describes  six  major  steps  where  systems  design  decisions 
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must  be  made  in  developing  a  forecast  system:  (l)  data,  (2)  model, 

(3)  smoothing  techniques,  (4)  forecast,  (5)  error  measurement,  and  (6) 
safety  factor.  All  of  the  material  discussed  is  to  be  included  as  part 
of  his  forthcoming  book,  Staoothing,  Forecasting  and  Prediction  of  Pis* 
Crete  Time  Series, 

John  Muth*s  study  illustrates  with  tvo  examples  the  interaction 
between  forecasts  and  inventory  control.  The  first  deals  with  a  steel 
firm  faced  with  warehousing  decisions  concerning  inventories  in  regional 
warehouses.  The  second  concerns  a  manufacturer  carrying  a  wide  line  of 
storage  batteries  for  automobiles,  trucks,  boats,  etc.  In  the  latter 
case  demands  appear  to  be  sensitive  to  weather  conditions.  In  both 
cases  it  was  necessary  to  predict  the  range  of  the  forecast  error  as 
well  as  the  forecast  itself.  Muth  points  out  that  analyzing  the 
decision-making  process  in  inventory  control  is  important  in  order  to 
(1)  know  what  to  forecast  and  (2)  to  understand  the  importance  of  fore¬ 
cast  errors.  It  is  meaningless  in  itself  to  know  that  forecast  accuracy 
is  within  +  10  per  cent.  The  relevant  infomation  is  the  quality  of 
the  decisions  based  on  the  forecasting  schemes. 

Peter  Winters  reported  on  tvo  esqponentially  weighted  forecasting 
models  with  respect  to  theory  and  practice.  One  of  the  models  contains 
a  linear  trend  and  ratio  seasonals,  with  three  cooatanta,  and  C, 

which  are  to  be  determined  from  past  data. 

He  defines  and  discxasses  three  criteria  of  prediction  accuracy. 

She  first  Is  a  weighted  sun  of  squared  forecast  errors;  the  second  an 
average  fractional  error  which  Is  the  ratio  of  the  average  absolute 
error  for  all  forecasts  made  divided  by  the  average  "sales"  (or  whatever 
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is  being  predicted)  over  the  forecast  period;  and  the  third  is  the 
standard  deviation  of  the  forecast  errors  together  with  the  coefficient 
of  variation. 

Experience  has  shown  that  approximately  the  same  A,  B,  and  C 
weights  are  optimal  for  a  wide  range  of  products,  so  that  it  is  reason¬ 
able  to  use  the  same  weights  for  groupings  of  products.  Furthermore, 
several  studies  have  indicated  that  the  coefficient  of  variation  is 
constant  over  a  wide  range  of  products  and  sales  levels.  For  one  part¬ 
icular  company  it  was  possible  to  delineate  two  groups  of  products  such 
that  within  each,  the  coefficient  of  variation  could  be  assumed  constant. 

Demand  prediction  from  a  commercial  viewpoint  is  discussed  by 
Winston  Dalleck.  He  describes  three  cases  of  forecasting  which  illu¬ 
strate  the  nature  of  the  problems  encountered  by  McKinsey  and  Company, 
and  how  they  attempted  to  deal  with  each  one. 

The  first  concerns  a  division  of  a  large  pharmaceutical  company 
producing  about  200  items,  each  of  which  has  a  high  seasonal  demand 
pattern.  An  exponential  smoothing  model  developed  and  used  by  Winters 
and  described  in  his  paper  proved  effective. 

The  second  example  deals  with  a  large  wholesale  and  retail  dis¬ 
tributor  of  metal  materials  and  metal  products .  They  have  an  inventory 
of  approximately  10,000  items.  Replenishment  leadtime  and  demand  are 
highly  variable.  The  problem  involved  providing  a  soxind  and  systematic 
way  to  review  and,  if  necessary,  recalculate  the  item  reorder  points. 
Monte  Carlo  routines  were  used  to  develop  a  large  number  of  distributions 
for  the  probability  of  usage  during  leadtime.  The  distributions  could 
then  be  classified  and  applied  directly  in  detemining  reorder  points 
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for  most  of  the  inventory  items. 

The  third  case  involved  a  company  which  produces  several  hundred 
items  in  a  number  of  plants.  Their  distribution  is  nation-wide.  The 
initial  trial  showed  that  the  exponential  smoothing  technique  provided 
a  satisfactory  approach  to  forecasting  demands  for  at  least  the  large 
volume  items,  even  in  the  absence  of  much  usable  historical  data. 

George  Fishman  discusses  briefly  the  theory  behind  the  concept  of 
the  power  spectrum  —  a  procedure  for  determining  the  relative  impor¬ 
tance  of  cyclical  and  seasonal  phenomena  in  monthly  time  series.  The 
procedure  for  estimating  the  spectrum  comes  under  the  heading  of  spectral 
sinalysis. 

He  illustrates  the  simplification  which  can  be  achieved  in  the 
theory  of  filtering  (elimination  of  cyclical  or  seasonal  components 
from  the  time  series)  by  working  in  the  frequency  domain  rather  than  in 
the  time  domain.  He  investigated  the  use  of  spectral  analysis  on  hog 
and  cattle  slaughter  time  series  of  50  years  duration.  He  discovered 
by  investigating  other  series  that  a  minimum  of  20  years  of  monthly 
data  were  needed  for  effective  analysis. 

Nowlan  points  out  that  when  we  are  studying  demand  figures  we  are 
really  studying  the  reliability  of  parts  and  components  through  the 
medium  of  demand  data. 

Qnil  Hamilton  proposes  some  areas  for  further  research  in  demand 
prediction.  Among  these  are:  the  application  of  Selective  Management 
principles,  the  sharpening  of  "qualitative/subjective"  approaches  for 
lov-demand  items,  the  developnent  of  a  capability  for  associating 
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technical  knowledge  of  the  item  with  the  relative  merits  of  various 
prediction  techniques,  and  a  review  of  earlier  studies  such  as  flyaway 
kit  concepts  in  an  attempt  to  update  and  re- slant  them  toward  new  modem 
weapons  and  logistics  applications.  Finally,  he  points  out  that  some 
effort  needs  to  be  expended  toward  helping  using  agencies  achieve  a 
better  understanding  and  acceptance  of  the  various  studies  and  proposals 
of  research  groups. 

And  finally,  the  Conference  Remarks  by  Kenneth  Arrow  pull  together 
some  of  the  discussion  which  took  place  during  the  presentation  of  the 
papers  and  the  formal  discussion  period. 
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THE  VALUE  OF  DEMAND  PREDICTION 

Albert  S.  Cahn 
The  RAND  Corporation 

Almost  since  the  inception  of  the  RAND  Logistics  Department, 
there  has  been  continuing  vork  and  study  on  the  problem  of  demand 
prediction.  This  interest  in  the  subject  on  RAND*s  part  reflects  a 
background  interest  by  the  Air  Force  that  I  am  certain  all  branches 
of  the  Armed  Forces,  as  well  as  commercial  organizations,  share. 

This  concern  is  quite  proper.  I  believe  that  no  discipline 
strikes  at  the  heart  of  most  logistics  problems  more  vitally  than 
the  demand  prediction  processes.  Logistics  problems  of  the  more 
interesting  sort  are  usually  concerned  with  choosing  the  proper 
course  of  action  in  the  face  of  demand  uncertainty.  Any  technique 
which  reduces  the  uncertainty  gives  that  much  more  hope  of  finding 
the  correct  logistic  action. 

Let  us  see  if  we  can  gain  some  idea  of  how  valuable  better  methods  of 
demand  prediction  mi^t  be  to  the  Air  Force.  Quite  obviously,  we 
cannot  arrive  at  an  exact  estimate  of  this  value.  But  by  making 
some  assumptions,  I  believe  the  order  of  magnitude  of  potentieil 
savings  can  be  calculated. 

At  the  present  time,  the  worldwide  stores  inventory  of  the  U.  S. 

Air  Force  consists  of  approximately  2,000,000  line  items  whose  total 
value  exceeds  $16,000,000,000.  It  is  impossible  to  state  just  how 
these  items  are  categorized  by  price  and  annual  demand,  because  no 
available  data  show  this  relationship  accurately.  However,  an  early 
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RMD  Report  made  such  a  classification  for  the  worldwide  inventory 
of  certain  aircraft  property  cleisses.  Figure  1  shows  this  price- 
demand  matrix. 
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Pig.  1  —  Percentage  of  Total  Line  Items  Classified  by 
Number  of  Units  Issued  and  Unit  Cost 


Let  us  assume  there  is  the  same  distribution  of  line  items  in  the 
present  day  inventory  as  that  shown  in  Fig.  1.  (Obviously  not  a  true 
assumption,  but  perhaps  not  too  unreasonable/)  Now,  let  us  focus 
attention  on  those  items  which  have  an  issue  rate  of  less  than  ten 
units  per  year,  and  a  unit  cost  between  $10.00  and  $10,000.00.  These 

^Bernice  B.  Brown,  Characteristics  of  Demand  for  Aircraift  Spare 
Parts*  The  RAND  Corporation,  R-292  (ad  July  195b.  ^ 
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are  the  items  which  normally  cause  much  trouble  —  the  slow-moving, 
erratically  demanded,  expensive  items*  In  Fig.  1  we  have  underlined 
the  percentages  which  refer  to  the  items  we  are  discussing. 

With  this  type  of  line  item  in  mind,  consider  the  effects  of 
different  stockage  policies  when  used  to  fill  the  demainds  for  these 
stochastically  demanded  items.  We  confine  our  attention  to  the 
situation  where  we  want  to  decide  how  many  of  a  line  item  to  stock 
if  we  know  its  cost,  the  probability  of  demand,  and  the  additional 
coat  caused  by  shortage  of  a  requested  item. 

For  this  purpose,  let  us  assume  the  demand  is  Poisson.  (Again, 
a  poor  assumption,  but  we  believe  it  is  not  important  for  the  argument 
we  intend  making!)  With  these  assumptions  in  mind  we  write  in  Table  1, 
for  the  case  of  a  spare  part  with  an  average  donand  of  one  unit  per 
time  period  considered,  the  supply  effects  of  different  quantities  stocked* 


Table  1 

DEMAHD  DISTRIBUTION  OF  SPARE  PARTS  WITH  AN  EXPECTED  DEMAND  OF 
1  UNIT  PER  TIME  PERIOD,  AND  EXPECTED  SUPPLY  RESULTS 
UNDER  SIX  STOCKAGE  POLICIES 


Number  of 
Units 
Demanded 

Probabil¬ 
ity  of 
Demand 

No.  of  Units 
Stocked  per 
Line  Item 

Ebcpected  Supply  E 
(No.  of  Ikiits  per  Li 

Results 
ne  Item) 

Surplus 

Consumption 

Shortage 

0 

0.3679 

0 

-  0  - 

-  0  - 

1.0000 

1 

0.3679 

1 

0.3679 

0.6321 

0.3679 

2 

0.1839 

2 

1.1036 

0.8964 

0.1036 

3 

0.0613 

3 

2.0233 

0.9767 

0.0233 

U 

0.0153 

U 

3.0043 

0.9957 

0.0043 

5 

0.0031  ' 

5 

4.0006 

0.9994 

0.0006 

6 
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If  we  adopt  the  point  of  view  that  surpliis  items  have  no  salvage 
value,  and  if  we  can  determine  a  shortage  cost  in  units,  then  we  can 
use  Table  2  to  calcxilate  the  un-utilized  expense  of  the  various  stockage 
policies.  This  expense  consists  of  the  sum  of  the  cost  of  the  surplus 
items  pl\as  the  shortage  costs.  This  is  set  forth  in  Table  2  for  cases 
whose  item  cost  is  equal  to  one-tenth  the  shortage  cost,  equal  to  the 
shortage  cost,  and  equal  to  ten  times  the  shortage  cost. 


Table  2 

UN-OTILIZED  EXPENSE  OF  VARIOUS  STOCKAGE  POLICIES 
(in  Terms  of  Units) 


Number 
of  Units 
Stocked 

Unit  Cost 
One-Tenth 
Shortage 
Cost 

Unit  Cost 
Equal  to 
Shortage 
Cost 

Unit  Cost 
Ten  Times 
Shortage 
Cost 

0 

10.0000 

1.0000 

0.1000 

1 

4.0469 

0.7356 

0.4046 

2 

2.1396 

1.2072 

l.ll40 

3 

2.2563 

2.0466 

2.0256 

k 

3.0473 

3.0086 

3.0047 

5 

4.0066 

4.0012 

4.0007 

From  Table  2  we  see  quite  obviously  that  if  the  \anit  cost  is 
one-tenth  the  shortage  cost,  then  the  preferred  policy  is  to  stock 
two  units;  if  the  unit  cost  and  shortage  cost  are  equal,  the  best 
policy  is  to  stock  one  unit;  if  the  unit  cost  is  ten  times  the  shortage 
cost,  then  the  best  ’policy  would  be  to  not  stock  the  item  at  all. 

However,  when  planning  for  the  stockage  of  any  particular  line 
item,  one  never  knows  jiost  \diat  the  expected  demand  for  an  item  will 
be.  All  one  can  ever  do  is  predict  that  the  expected  demand  will  lie 
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between  certain  limits.  Ibe  narrower  the  limits,  the  better  the  pre¬ 
diction  will  be.  We  attempt  to  evaluate  this  ability  to  predict  within 
narrower  limits  in  this  paper. 

If,  on  the  basis  of  experience,  the  eigpected  demand  for  an  item 
lies  between  zero  and  two,  then  with  no  further  information  it  is 
possible  to  assume  that  the  probability  of  the  ejected  demand  is 
distributed  uniformly  over  that  interval.  Or  perhaps  one  can  Imagine 
the  situation  where  we  have  a  large  number  of  items  with  esqpected 
demand  distributed  uniformly  over  that  interval  so  that  the  average 
esqpected  demand  is  one,  but  we  are  unable  to  forecast  for  any  particu¬ 
lar  item  just  what  the  esqpected  demand  is.  We  mention  parenthetically 
that  assuming  uniform  distribution  of  expected  demand,  while  helpful 
inasmuch  as  it  sinpllfles  the  cooputaticxis,  is  not  necessary  to  the 
argument.  One  could  make  a  similar  calculation  for  any  distribution. 

In  that  case,  the  un-utllized  cost  of  any  stockage  policy  must  be 
integrated  over  the  required  interval.  For  the  case  where  the  Interval 
ia  from  zero  to  two.  Table  3  shows  the  average  un-utlllzed  ejqpense. 

Note  that  these  values  differ  from  Table  2  which  is  for  an  average 
ejected  demand  of  one.  Also,  the  figures  imply  a  different  optimal 
stockage  policy  when  the  unit  cost  is  one-tenth  the  shortage  cost.  In 
that  case,  the  optimal  policy  is  to  stock  three  units  rather  than  two, 
as  implied  by  \ise  of  the  average  e^qpected  demand  (Table  2) . 

Now,  let  us  see  if  we  can  calculate  the  potential  savings  which 
would  result  if  we  were  able  to  predict  the  e3q>ected  deound  for  any 
line  item  within  narrower  limits  than  these.  This  is  best  shown 
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Table  3 

AVERAGE  UN-OTILIZED  EXPENSE  OF  VARIOUS  STOCKAGE  POLICIES  WHEN 
EXPECTED  DEMAND  VARIES  UNIFORMLY  BETWEEN  ZERO  AND  TWO 
(in  Terms  of  Units) 


Nmber 
of  Units 
Stocked 

1 

Unit  Cost 
One-Tenth 
Shortage 
Cost 

Unit  Cost 
Equal  to 
Shortage 
Cost 

Unit  Cost 
Ten  Times 
Shortage 
Cost 

0 

10.0000 

1.0000 

0.1000 

1 

0.8611-5 

0.4755 

2 

2.6952 

1.3230 

1.1776 

3 

2.5786 

2.1052 

2.0579 

k 

3.1653 

3.0301 

3.0165 

5 

k.okka 

4.0075 

4.0042 

graphically  in  Fig«  2  where  un-utilized  expanse  (in  terms  of  units) 
is  plotted  versus  expected  demand  for  the  cases  where:  zero,  one, 
two,  three,  four,  and  five  units  are  stocked,  and  when  the  shortage 
cost  is  taken  to  be  ten  times  the  unit  cost*'’^  If  one  knot^s  of  a 
certain  line  item  only  that  its  expected  demand  is  between  zero  and 
two,  then  the  best  policy  is  to  stock  three  of  the  item  (see  Table  3) 
and  have  an  un->utilized  expense  equal  to  the  average  ordinate  of  the 
curve  for  stocking  three  units,  which,  in  this  case  is  2.5786  units. 

On  the  other  hand,  if  one  possessed  some  means  of  predicting 
within  narrower  limits  what  the  expected  demand  is,  then  one  could  do 
better  than  this.  For  example,  again  referring  to  Fig.  2,  if  one 


The  points  on  the  various  stockage  policy  curves  for  an  expected 
demand  of  1.0  are  the  values  listed  in  the  second  column  of  Table  2. 
For  other  expected  demands,  the  points  on  the  various  curves  were 
computed  in  a  similar  manner.  The  values  presented  in  Table  4f  which 
are  proportional  to  the  araas  under  the  various  curves,  wsn  obtained 
by  numerical  integration. 


Unutilized  expense  (units) 


Fig.  2 — Unutilized  expense  versus  expected  demand 
(shortage  cost  ten  times  unit  cost) 
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were  able  to  predict  correctly  whether  the  expected  demand  for  a  given 
line  item  fell  within  one  of  the  five  demand  intervals  labeled  from 
zero  to  fo\ar  in  that  Fig\ire,  then,  by  stocking  the  quantity  indicated, 
one  woiiLd  have  an  average  expected  cost  (over  the  entire  set  of  items) 
found  from  the  lower  envelope  of  Fig.  2.  In  this  case,  the  cost 
turns  out  to  be  I.9878  \mits.  The  shaded  portions  of  Fig.  2  represent 
the  savings,  O.5908  units  here,  that  result  from  this  added  knowledge. 
This  amounts  to  a  savings  of  22.9^  over  the  optimal  stockage  policy 
indicated  when  we  do  not  have  the  ability  to  predict  accurately 
within  the  narrower  limits. 

This  potential  saving  in  un-utilized  expense  that  wo\iLd  result 
from  an  ability  to  predict  expected  demand,  naturally  varies  with  the 
ratio  of  unit  cost  to  shortage  cost.  Table  k  shows  this  saving  for 
fo\ar  values  of  the  ratio.  The  saving  for  a  ratio  of  10  was  computed 
above.  The  other  savings  figures  were  obtained  in  a  similar  fashion. 

Table  4 

PERCENTAGE  SAVINGS  RESULTING  FROM  ABILITY  TO  PREDICT  EXPECTED 
DEMANDS  WITHIN  NARROWER  LIMITS  FOR  VARIOUS  RATIOS 
OF  SHORTAGE  COST  TO  UNIT  COST 


Ratio  of 
Shortage  Cost 
To  Unit  Cost 

Un- utilized 
Expense  Without 
Prediction 
Ability 

Un-utilized 
Expense  With 
Prediction 
Ability 

Savings  as 
Percentage 

0.1 

0.1000 

0.1000 

0.00 

1.0 

0.86^5 

0.6963 

19.46 

10.0 

2.5786 

1.9878 

22.91 

100.0 

4.3809 

3.3198 

24.22 

*e.g..  If  the  expected  demand  were  less  than  0.1,  then  no  parts 
should  be  stocked;  for  expected  demand  between  0.1  and  0.5,  one  part 
should  be  stocked;  for  expected  demand  between  0.5  and  I.06,  two 
parts  should  be  stocked;  etc. 
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In  order  to  translate  the  potential  savings  exhibited  in  Table  5 
into  dollars,  it  is  necessary  to  assume  a  value  for  the  shortage  cost. 
This  is  difficult  to  do  accurately.  For  the  purposes  of  this  paper 
let  us  assume  a  shortage  cost  of  $1,000.  This  is  not  an  unreasonable 
amo\ant  when  one  reflects  on  the  efforts  used  by  the  Air  Force  to 
obtain  a  needed  part  related  to  mission  effectiveness.  The  assumption 
of  a  shortage  cost  of  $1,000  allows  \is  to  relate  Table  4  to  the 
section  of  the  Air  Force  inventory  represented  by  the  underlined 
percentages  in  Fig.  1,  namely,  the  low  demand  items  varying  in  cost 
from  $10.00  to  $10,000.00. 

Figure  1  expresses  the  percentage  of  line  items  in  the  inventory 
vhich  satisfy  the  price-demand  characteristics  indicated.  Assuming 
that  the  yearly  buy  has  the  same  composition  as  the  inventory,  then 
we  can  calcxilate  from  Fig.  1  the  dollar  percentage  of  the  anniaal  b\jy 
classified  by  number  of  units  issued  and  unit  cost.  Fig.  3  shows  this. 


100,000 
10,000 
1,000 

100 

10 

0  1  10  100  1,000  10,000 


- 

1^.30 

2.44 

T.21 

0.73 

4.61 

19.09 

0.11 

1.29 

5-94 

14.79 

24.02 

0.02 

0.33 

1.85 

4.29 

8^ 

Unit  Cost  (dollsLrs) 

Pig*  3  --  Percentage  of  Cost  of  Annual  Buy  Classified 
by  Number  of  Uiits  Issued  and  Unit  Cost 
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We  are  now  in  a  position  to  estimate  the  dollar  value  of  the 
potential  savings  by  multiplying  the  percentage  of  the  cost  of  the 
annual  buy  of  a  particular  price-demand  class  by  the  average  potential 
saving  percentage  of  that  class.  Table  ^  suamarizes  this  as  follows. 


Table  5 

AN  ESTIMATE  OF  POTENTIAL  SAVINGS 


Unit  Cost 
Class 

Percentage 
of  Cost  of 
Annual  Buy 

Percentage 

Average 

Potential 

Saving 

Product 

From  $1,000 
to  $10,000 

8.98^ 

9-73^ 

0.8t^ 

From  $100 
to  $1,000 

4.29^ 

21.19^ 

0.909^ 

From  $10 
to  $100 

1.85^ 

23.57^ 

Total 

In  effect,  our  assumptions  indicate  that  the  potential  savings  resulting 
from  narrower  limits  on  the  prediction  of  expected  demands  should  amount 
to  approximately  2^  per  cent  of  the  annual  buy  cost. 

Since  the  Air  Forceps  annual  buy  of  spare  parts  is  in  excess  of 
two  billion  dollars,  this  means  that  the  potential  savings  woiILd  be 
between  forty  and  fifty  million  dollars  per  year.  Annual  savings  of 
this  amount  are  more  than  enoiagh  to  jiastify  intensive  work  in  order 
to  see  whether  or  not  we  can  find  better  ways  to  predict  expected  demands. 
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A  COMPARATIVE  STUDY  OF  PREDICTION  TECHNIQUES 

Majc  Astrachan 
The  RAND  Corporation 

Almost  from  its  inception,  the  Air  Force  has  had  the  problem  of 
predicting  demands  for  spare  parts#  Reasonably  accurate  estimates  of 
how  many  units  of  a  particular  line  item  will  be  required  in  a  future 
time  period  are  extremely  important  to  their  operations.  The  Air 
Force  needs  such  estimates  for  effective  and  economical  procurement, 
distribution,  maintenance,  and  program-planning  decisions.  Numerous 
studies  of  the  Air  Force  supply  system  point  out  that  improved  demand 
predictions  could  result  in  substantial  savings. 

Various  aspects  of  demand  prediction  have  been  under  study  almost 
continuously  at  RAND  and  elsewhere.  Some  RAND  studies  have  primarily 
attempted  to  describe  characteristics  of  spare  parts  demands.  Others 
have  developed  methods  for  predicting  demands  or  for  evaluating  pre¬ 
diction  techniques.  See  Astrachan,  Brown,  and  Houghten-w*  for  a  detailed 
description  of  the  first  research  performed  at  RAND  using  real  data 
to  evaluate  different  prediction  techniques.  The  present  paper  is  a 
precis  of  that  study^s  procedures  and  results. 

Forecasting  demands  always  involves  some  uncertainty.  In  using 
statistical  techniques,  such  as  those  in  this  study,  the  forecaster 
applies  the  concepts  of  population  and  random  sampling  to  develop 
procedures  to  deal  with  this  uncertainty. 

^Max  Astrachan,  Bernice  B.  Brown,  and  J.  V/.  Houghten,  A  Comparative 
Study  of  Prediction  Techniques.  The  RAND  Corporation,  RM-2811-PR,  December, 
1961  (limited  Distribution A 
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It  Is  possible  to  think  of  the  demsnds  for  a  line  item  during 
some  fbture  time  period  m  a  random  drawing  from  a  theoretieeil  (unknown) 
population,  or  distribution  of  possible  demands  for  that  time  period. 

If  the  forecaster  can  learn  sosmthing  about  the  properties  of  this 
distribution,  he  msy  be  able  to  reduce  his  total  uncertainty  about 
the  future.  For  exaiig>le,  he  may  learn  something  about  the  mean  of 
the  distribution,  or  about  the  range  of  the  nuidbers  in  it.  This  in¬ 
formation  will  enable  him  to  make  better  predictions  of  the  actxial 
demands,  or  determine  limits  within  which  they  may  lie.  As  he  learns 
more  about  this  future  population,  his  uncertain^  will  be  less,  and 
his  predictions  better. 

One  way  the  forecaster  leeurns  is  by  analyzing  historical  data  to 
acquire  sosie  knowledge  of  past  populations  of  desmnds.  He  then  assumes 
a  relationship  between  future  and  pMt  populations.  For  example,  be 
may  be  able  to  determine  a  demand  rate  from  collected  data,  then  assume 
that  the  future  population  will  have  the  same  demand  rate  as  the  past. 
Another  way  is  by  his  practical  knowledge  and  experience,  l.e.,  his 
knowledge  about  the  parts  in  question  or  similar  ones,  and  his  a^per- 
ienoe  in  making  past  predictions. 

The  present  study  concerns  ways  of  using  data  from  unfolding 
demand  experience  to  make  predictions  with  the  help  of  statistical 
procedures.  It  shows  how  the  data  can  be  used  to  obtain  information 
about  the  populations  ffom  which  future  demands  will  be  drawn.  This, 
together  with  some  assumptions  and  a  known  activity  program,  will 
enable  the  forecaster  to  predict  demands.  The  study  examines  seven 
different  predlctlan  teehnlfiiMs;  then  eemperee  the  results. 
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Tg  SBVIH  TBCHHiqUEB 

Table  1  lists  the  seven  prediction  techniques  which  this  study 
discusses  In  detail  later  on.  They  eire  based  on  two  essentially 
different  usuiqptlons  about  the  relationship  between  past  and  future 
populations  of  demsnds  for  the  same  Item. 

Table  1 

THE  SEVEN  TECHNIQUES 

I .  Issue-rate 

II.  ^pper  Bound  —  Poisson 

III .  Non-Paraisetrlc  Poisson 

IV.  Upper  Bound  —  Normal 

V.  Service  Life  —  Normal 

VI.  Service  Life  —  Log  Normal 

VII.  Actuarial 

The  first  four  techniques  assume  a  constant  demand  rate  over  time, 
so  that  the  relationship  between  past  and  futtire  demand  populations  Is 
a  function  only  of  the  total  program  activity  In  each  period.  Table  2 
raaarlsas  the  la|K>rtaiit  features  of  these  four  teebBigues. 

Table  2 

FEATURES  OF  CONSTANT  aMAND  RATE  TBCHRIQUB3 

o  Relatloxushlp  between  populations  affected  only  by 
program  activity 
o  Requires  only  gross  data: 

Tbtcd.  nimiber  of  denands 
Total  number  of  program  elements 
o  Inei^exmlve  to  use 

They  require  data  about  the  total  ninriDer  of  demands  that  have  occurred 
In  the  past  (l.e.,  during  the  e3Q>erlenee  period),  and  the  total  program 
activity  In  the  past  and  future  time  periods.  As  a  result,  they  are 
relatively  eoonondLcal  to  use,  a  fact  of  logportance  to  data  collectors 
and  proeassors.  The  issue-rate  techniqiue  is  now  being  used  in  the  Air 
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Force.  The  other  three  are  upper-bound  techniques  designed  to  give 
sons  assurance  that  under-predlctlon  vlU  not  occur  often  if  the  con¬ 
stant  demand  rate  asstsaption  is  valid. 

Table  3  shows  the  features  of  the  three  service -life  techniques 
(y,  VI  and  VII) .  They  assume  that  the  relationship  between  put  and 
2\tture  demand  populations  is  affected  both  by  the  total  program  utlv- 
i'ty  in  the  various  periods  and  by  the  age  of  the  units  contributing 
to  that  actlvl'ty.  Ttese  techniques  mlg^t  be  expected  to  predict  better 

Table  3 

FEATURES  OF  SERVICE-LIFE  TECHNIQUES 

o  Relationship  between  populations  is  affected 
by  program  eurfcivlty  and  age  of  Installed  units 
o  More  accurate  for  items  that  wear  out  because 
of  age 

o  Require  detailed  data  about: 

Ifuniber  of  demands 
Age  of  falling  units 
Age  of  installed  imlts 
o  Esqpensive  to  use 

for  items  that  tend  to  wear  out  because  of  age.  The  trouble  is,  how¬ 
ever,  that  they  require  data  not  only  on  the  number  of  put  dmands, 
but  also  on  the  eige  of  both  the  falling  units  ud  the  svovivlng 
installed  units  (age  is  meuxired  by  the  utlvlty  element) .  Because 
of  the  data  requirements  and  the  extensive  cosqnitations  that  these 
techniques  Involve,  it  would  cost  much  more  to  use  them  than  mtmy 
others  bued  on  different  usxaqptlons.  A  rough  estimate  showed  that 
the  ccngnitatlon  costs  only  of  the  service -life  techniques  used  in  this 
study  were  appraximately  sixty  times  that  of  the  non-service-Ufe 
techniques.  The  cost  of  mahlng  one  of  naxy  service-life  predictions 
is  about  forty  cents,  coiqpared  to  lass  than  one  cent  for  the  non- 
servlce-Ufe  teehnlq]aes. 
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Although  each  technique  Is  described  verbally  belov,  It  Is  also 

convenient  to  have  formulas  for  sone  of  then.  For  this  puz^ose  we 

use  the  following  notation: 

d  actual  number  of  demands  In  a  given  month; 

D  ■:  numiber  of  demands  In  the  eq^rlence  period  e^d,  where  the 
sum  Is  tcUcen  over  the  sionths  In  the  experience  period; 

ft  s  predicted  nimfcer  of  demands  for  a  given  month; 

F  s  activity  of  the  weapon  system  during  the  experience  period; 
nimiber  of  flying-hours  for  aircraft  and  nuid>er  of  checkouts 
for  missiles;  and 

f  B  activity  of  the  weapon  system  during  the  month  for  which  the 
prediction  Is  made. 

Technique  I  (Issue-Rate) 

As  previously  mentioned,  the  Air  Force  now  uses  the  Issue-rate 
technique  to  predict  demands.  The  total  nuaX>er  of  demands  for  a  given 
part  during  am  experience  period  Is  divided  by  the  total  activity  of 
the  weapon  system  during  this  period  to  give  an  average  demand  rate. 
Assuming  demand  for  this  part  continues  at  the  same  rate  In  the  future 
(constant-demand-rate  assuBq?tlon) ,  we  then  obtain  the  forecast  for  a 
particular  month  by  multiplying  this  average  demand  rate  by  the  month's 
planned  activity.  In  spidMls: 

ft  ■ 

Ifote  we  eussume  that  every  unit  of  activity  gives  the  part  the  same 
exposure  to  failure,  and  that  the  past  diamnd  rate  Is  taken  as  an 
estimate  of  the  mean  demand  rate  of  the  future  population  of  demands. 
Ho  assumptions  are  made  about  the  distribution  of  dsmanile  In  the 
future  populations. 
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Teehnlqiues  II,  III,  and  IV  are  iqnper-bound  techniques.  They 
constitute  a  hedge  against  the  possibility  of  an  Increasing  denand 
rate  for  peurts  for  vhlch  there  Is  not  enough  Inforaatlon  to  detenslne 
the  validity  of  the  assuiqptlon  of  a  constant  or  declining  denand  rate 
over  time  during  the  given  experience  period.  S\ich  parts  may  exhibit 
servlce-Ufe  characteristics  over  Icmger  experlsnce  periods. 

Technique  II  (Upper-bound  —  Poisson) 

This  technique  protects  against  underpredictions  by  using  an 
upper  bound  on  the  mean  of  a  Poisson  distribution.  We  assume  that 
the  nvaber  of  demands,  D,  In  the  experience  period  Is  drawn  from  a 
Poisson  distribution  of  unknown  meaui  and  that  the  demand  rate  Is  con¬ 
stant  over  time.  D  Is  used  to  find  the  upper  bound  of  the  90-per-cent 
confidence  interval  for  this  mean.  The  upper  bound  Is  then  used  in 
the  same  manner  as  D  In  Tecbnlqiie  I  to  obtain  the  prediction  d.  We 
divide  the  tq>per  bound  by  the  total  activity  of  the  veq;>on  system  In 
the  experience  period,  and  then  multiply  by  the  planned  activity  for 
the  month  for  which  the  prediction  Is  being  made. 

dbchnlque  III  (Hon-parametrlc  Poisson) 

This  technique,  developed  in  an  unpublished  paper  by  D.  8.  StoUer 
of  The  BAUD  Corporation,  can  be  thouc^t  of  as  a  stockage  policy.  We 
assume  that  danands  follow  a  Poisson  distribution  and  that  the  dewanil 

» 

Values  of  the  upper  bound  for  different  values  of  D  have  bean 
tabulated.  See,  for  exaaiple,  I.  8.  Pearson  and  I.  0.  Bartley, 

Tables  for  Statlstleians.  Vol.  I.  The  Ctalversitar  Press.  flsi<irHss 

1^,  p.  vs: 
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rate  renaius  consteuit  over  tlnei  m  in  Technique  II*  Since  It  does 
not  require  an  estlaate  of  the  parameter  (mean)  of  the  dlstrlhution 
Technique  III  Is  called  a  non-peiraaiatrlc  Poisson  technique. 

The  predicted  value,  tl.  Is  obtained  by  solvliig  the  equation 

(pft  -  qp)^  -  p^(ft  ♦  D) 

ehere 

P  -  p  V  f  *  <1  -  1  -  P, 

and  Is  the  noaiber  of  standard  deviations  in  the  standard  normal 
distribution  corresponding  to  a  lOOC  per  cent  tall.  We  used  «  1.6$, 
uhlch  corresponds  to  a  $  per  cent  tall.  Other  values  may  be  used,  of 
course.  The  solution  tl  of  the  above  eq\iatlon  then  has  the  property 
that  the  probability  that  actual  deamnd  in  scam  future  month  will 
eacceed  the  predicted  value,  d.  Is  less  than  0.0$,  provided  the  assu^p- 
tloDS  are  tzue.  The  predicted  value  can  thus  be  regarded  as  an  upper- 
bound  decision  on  the  amount  to  be  supplied  to  meet  damemd. 

Technique  IV  (Upper-Bound  —  normal) 

This  technique  provides  sons  protection  against  underpredlctlons 
by  using  an  iqpper  bound  on  the  mean  of  a  nozmal  distribution.  WC 
assume  that  the  nuiri>er  of  demmds  D  In  the  experience  period  Is  normally 
distributed  about  sons  unknown  neon  with  variance  (square  of  standard 
deviation)  eq^al  to  three  times  the  observed  demand,  and  that  the 
demand  rate  is  constant  over  tims.  To  insure  a  non-sero  estimate  of 
the  upper  bound  when  D  is  zero,  one  is  added  to  the  obaerved  demand. 

The  upper  90^par.esnt  oonfldanoa  Halt  for  tha  unknowa  maan  la  than 
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(D  l)  -t-  1.6^  3(1>1)  •  The  forecut  Is  this  vqpper  limit  adjuted 

for  the  activity  of  the  veapoD  system  In  the  experience  and  predletioa 
periods;  i.e.: 

,  (DU)  ♦  1.65  ^  3(01)  (j) 

y 

Techniques  I-IV  involve  only  the  total  number  of  demands  and  the 
total  activity  of  the  veapcmi  system  during  the  experience  period, 
together  vlth  the  anticipated  utlvlty  for  the  prediction  month,  in 
order  to  malse  the  forecuts.  They  usume  the  demand  rate  is  constant 
over  time.  Techniques  V-VII  are  more  sophisticated,  requiring  an 
estimate  of  the  part's  service-life  characteristics  derived  from  his¬ 
torical  data.  .  It  is  custoemry,  in  this  context,  to  think  in  terms  of 
failures  rather  than  demands;  for  our  puzpoM  the  terms  are  inter¬ 
changeable. 

Techniques  V  and  VI  (Service  Life  —  Normal,  ud  Service  Life  — 
tot  WonpsJT 

Both  of  these  techniques  are  adaptatiou  of  the  Minimum  Noxmlt 
Chi-Square  method  developed  by  Berkson.  Euh  congprlses  tvo  pcurts. 

First  ve  utimate  the  service-life  characteristics  of  the  line  item; 
second,  ve  use  these  estimates  to  forecut  demands  in  future  months. 

The  methodology  usumu  a  normal  distribution  of  agu  at  fallxore. 

Hon-normal  data  can  often  be  xiormallzed  by  using  a  logarithmic 
transformation.  We  do  this  in  Technique  VI  using,  however,  the  loga¬ 
rithm  of  one  plus  age  instead  of  age.  Except  for  this,  the  procedure 
la  the  same  u  for  Technique  V.  !Die  results  are,  of  course,  then 
transformed  back  into  age. 

'Joseph  Berkson,  "Tahlu  for  Use  in  Estimating  the  Hdraal  Distribu¬ 
tion  Finctlon  by  Normlt  Analysis, ”  Biometrlka,  Vol.  44,  1947>  pp>  411-435. 
Bmrkson  dueribu  the  buie  technique  and  dlseuMss  its  efrieienoy  under 
special  conditions. 
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fohnlQue  VII  (Actuarial) 

This  Is  another  sezvlee-llfe  technique.  It  is  known  as  the  actuarial 

■athod  since  it  is  conparable  to  the  methods  life  insurance  coaqpanies 

use  to  construct  mortality  tables.  The  Air  Force  cuinrently  uses  it  to 

# 

predict  engine  failures .  As  with  Techniques  V  and  VI,  the  procedure 
has  two  steps.  The  first  Involves  determining  the  paurt's  service-life 
charaeteristica  that  are  set  forth  in  a  mortality  table.  The  second 
step  lases  this  table,  the  weapon-system  inventory,  and  the  activity 
program  to  isake  the  actual  forecasts. 

•nm  niTA  ahd  ombkal  prockdurb 

In  order  to  find  ovtt  which  of  the  seven  techniques  is  likely  to 
give  the  most  auscurate  predictions,  we  aure  coag?aring  their  ability  to 
predict  the  demands  for  a  vide  range  of  items.  Table  4  gives  some 
relevant  data. 

Table  4 
THE  DATA 

o  B-52  Irving  Report 

33  months  —  January  1956-8epteal>er  195o 
Data  from  two  bases 
Sample  of  272  pau:^8 

o  Missile  (Falcon) 

26  months  —  Nay  1933*June  19$7 
System-wide  data 

27  cooponents 

We  have  33  months  of  data  on  a  sample  of  272  B-32  Hi-Valu  and  Category 
II  recoverable  items,  and  26  months  of  data  on  27  different  coaponents 

For  a  detailed  discussion  of  the  methodology,  see  T.  0.  00-23-126, 
"Procedures  for  Determining  Alrcraift  Engine  (Frop^i<ni  Uhlt)  Failure 
Rates,  Actuarial  ftiglne  Life,  and  Forecasting  Monthly  Engine  changes 
by  tbs  Actuarial  Method,"  October  20,  1939* 
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of  the  FalcoD,  an  air-to-air  miasile.  Using  the  same  data  every 
time,  we  employ  each  technique  in  turn  to  make  demand  predictions. 

The  process  of  measuring  the  comparative  accuracy  of  the  results  than 
goes  through  a  regular  series  of  steps  presented  in  Table 

Table  5 

STEPS  IN  MEASURING  ACCURACY 

o  Predict  future  demands 

Each  month  predict  demands  for  each 
of  the  subsequent  12  months 

o  Cosvute  the  average  monthly  error 

o  Compute  the  relative  error 

100  -£■«-  'ii _ 

o  Cospute  the  root  mean  square  error 


With  the  addition  of  each  month’s  eiccumulated  danand  data,  pre¬ 
dictions  of  the  demands  are  made  for  each  item  in  each  of  the  12 
subsequent  months.  A  comparison  of  the  predictions  with  the  actual 
recorded  demands  follows,  to  see  how  large  the  errors  wotild  have  been 
under  real  clrctimstances .  Three  statistics  are  computed  from  each 
of  the  12-month  prediction  sets:  an  average  monthly  error  (AMB),  a 
relative  error  (RE),  cmd  a  root  mean  squeure  error  (RMS). 

Since,  as  pointed  out  earlier,  the  data  cure  constant,  l.e.,  \islng 
the  same  data  for  each  of  the  seven  techniques,  we  aze  in  a  position 
to  compare  their  cuscuracy  in  making  predictions  using  the  three 


izues  we  have  Introduced 
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In  eooswurlng  teehnlqties,  the  average  error  allovs  \is  to  conpare 
how  much  bias  each  technique  has  in  predicting  monthly  desiands,  and 
reflects  the  error  in  predicting  the  toteil  denands  for  the  year.  The 
relative  error  eiUovs  us  to  compare  the  relative  importance  of  those 
errors,  and  the  root  mean  square  error  magnifies  the  Importemce  of 
the  largest  monthly  errors  so  that  a  coagarlson  will  reveal  ^ich 
technique  is  best  able  to  predict  when  the  demEuids  will  occtir  during 
the  prediction  year.  The  root  meeui  square  Indicates,  therefore, 
vhether  we  can  predict  demands  for  phased-repalr  or  procurement  pur¬ 
poses.  The  average  monthly  error  may  show,  for  Instance,  that  a 
technique  has  predicted  demands  accurately  for  the  12-month  period. 
When  this  accuracy  has  been  obtained  by  greatly  over-predicting  for 
some  months  emd  greatly  \inder-predicting  for  others,  however,  the  root 
mean  square  error  will  show  that  the  individual  monthly  errors  were 
large  even  though  the  average  error  was  small.  We  would  thvis  know 
that  we  cannot  saifely  phase  deliveries  or  schedule  repairs  rigidly  on 
the  basis  of  these  monthly  predictions. 

Many  different  procedures  can  be  followed  in  selecting  the  pre¬ 
ferred  technique  for  a  given  part.  We  proceeded  as  follows:  In 
general,  a  peurt  has  very  few  demands  during  its  eeu:ly  months  on  a 
weapon,  and  hence  some  noi-statlstlcal  prediction  technique  would 
have  to  be  used  during  this  time.  So  we  rather  arbitrarily  began  with 
12  months  of  experience  for  the  B-^2  parts  and  8  months  for  the  Ihlcon 
eoiqponents.  This  left  us  with  10  prediction  sets  for  the  former  euad 
7  for  the  latter.  Since  our  primary  objective  was  predicting  demands 
for  a  year  in  the  future  rather  than  on  a  month-te-month  baeis,  we 
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first  exaailned  the  average  monthly  errors  for  the  part  based  on  a 
given  experience  period,  beginning  at  these  points  In  tine.  The 
technique  vhlch  has  the  smallest  AMB  Is  the  preferred  one;  l.e.,  It 
gives  the  best  predictions  for  a  yeeo:  based  on  the  given  experience. 
Next  ve  examined  the  pattern  of  the  AMB's  over  time  In  Mcordance 
vlth  the  criteria  discussed  above,  to  select  a  single  technique  If 
possible  which  would  have  the  smallest  AMB.  For  some  peurts,  one 
technique  was  better  than  the  others  for  one  experience  period  amd 
worse  for  the  next.  In  order  to  avoid  shifting  back  and  forth  among 
techniques  we  selected  as  preferred  the  <»ie  which  had  the  smallest 
AMB  for  the  largest  nusher  of  prediction  sets,  If  there  was  such  a 
one.  Mhen  It  was  not  possible  to  select  a  preferred  technique  on 
this  basis,  ve  examined  the  root  mean  square  errors  In  the  same  manner 
euB  the  average  monthly  errors,  seeking  the  technique  with  the  smallest 
month-to-month  variation  for  the  largest  number  of  prediction  sets. 

If  this  did  not  yield  a  preference,  ve  examined  all  the  AMB's  for 
the  part,  the  number  of  over-  and  underpredictions,  homing,  nunfcer 
of  demands,  etc.,  to  make  our  selection.  This  introduced  scam  sub¬ 
jectivity  into  Ihe  choice  for  those  tmr  parts  for  which  this  was 
necessary. 

fbr  soam  of  the  parts  a  service-life  technique  —  V,  VI,  or  VII  — 
was  preferred  during  the  latter  peurt  of  the  program.  One  reason  was 
that  not  enough  demands  had  accuaulated  during  the  early  months  to 
enable  us  to  use  them.  We  then  chose  the  best  among  the  first  four 
techniques  for  the  early  part  of  the  program. 


Taenty-ooe  for  the  B-$2  parts  and  l4  for  the  Falcon  conponents 
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APPLICAIIOW  TO  B-52  DMA 

We  turn  now  to  the  application  and  eyaluatioo  of  the  seven  teeh> 
nlques  as  applied  to  the  B-^2  Bata. 

We  chose  for  stiidy  Hi-Valu  and  Category  II  recoverable  itens  only, 
in  six  major  property  classes.  These  six  classes  were  Engine  Coo^- 
nents,  Airframe  Structural  Coogponents,  Gunnery  Congionents,  Boablng 
Fire  Control  Coiqponents,  Ccamunlcatlons  Eq.\d.pment,  and  Aircraft 
Accessories.  There  were  87^  peurts  in  these  six  classes  with  demands 
of  3  or  more  during  the  33-month  data  collection  period.  (All  parts 
in  the  original  listing  which  had  fewer  than  ^  denands  were  eliminated.  ) 
We  chose  a  saiig>le  of  300  from  these  six  classes,  30  in  each.  Deletions 
and  combinations  of  peurts  reduced  the  sample  number  to  272. 

About  to  per  cent  of  the  peoi^s  in  the  sample  were  Hi-Valu,  while 
60  per  cent  were  Category  II  reparables;  l44  of  them  had  no  demands 
in  the  first  yeeo*  of  the  program  emd  7D  li&d.  none  during  the  first  21 
months.  During  the  entire  33->nonth  period  there  were  no  demands  for 
about  two-thirds  of  the  part-months. 

Table  6  shows  the  number  of  sample  parts  in  each  proper^  class 
to  which  eeich  technique  was  applied. 

Table  6 


Property  Class 

Techniques  and 
Number  of  Parts 

I-IV 

I-VI 

I-VII 

Engine  components 

47 

9 

Airframe  structural  components 

45 

35 

1 

Gunnery  components 

46 

30 

Bombing  fire  control  components 

38 

24 

4 

Communications  equipment 

48 

16 

5 

Aircraft  accessories 

_48 

_31 

2 

Total 

272 

145 

12 

Five  was  selected  arbitrarily  for  the  purpose  of  this  study. 
About  6500  parts  had  fewer  than  5  demands  duri^  the  entire  data 
collection  period* 
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The  fiirst  four  techniques  vere  applied  to  all  272  parts.  In  order 
to  use  Techniques  V  and  VI,  ve  required  coiqplete  data  on  parts  which 
bad  at  least  four  denands  during  the  experience  period.  This  limited 
their  applicability  to  145  peurts .  The  Air  Force  Technical  Order  des¬ 
cribing  the  actuarial  method  (Technique  VIl)  suggests  that  data  on 
aboixt  100  fallxires  should  be  available  In  order  to  use  It.  We  required 
data  on  10  falliures  during  the  first  nine  months.  Even  then  we  were 
able  to  use  Technique  VII  on  only  12  pcurts. 

There  were  165  different  aircraft  In  the  sttidy.  Beginning  with 
the  12th  month,  there  were  between  85  and  100  planes  on  the  two  bases 
dtirlng  any  one  month.  About  68,000  flying-hours  were  accoopUshed 
during  the  33  months.  There  were  2500  aircraft-months  of  data,  with 
an  average  activity  level  of  approximately  30  flying-hours  per  plane 
per  month.  The  nxmiber  of  flying-hours  Increased  slowly:  only  55 
per  cent  of  the  total  number  was  accomplished  by  the  end  of  the  21st 
month,  at  which  time  we  made  the  last  predictions  for  a  year  in  the 
future.  About  42  per  cent  of  the  demands  for  the  2J2  sample  peurts 
occurred  during  the  first  21  months,  and  58  per  cent  during  the  last 
year. 

An  examination  of  the  cost  of  the  pairts  In  our  saiqple  Is  of  sons 
Interest.  There  were  II8  (43  per  cent)  which  cost  over  ^500.  Of 
these,  46  (39  per  cent)  had  fewer  than  20  demands,  and  69  (58  per  cent) 
fewer  than  33  demands,  or  less  than  ed>out  one  per  month.  There  were 
12  parts  which  cost  more  than  $10,000.  One  part  In  this  group,  an 
antenna  asseid>ly  seaurch  radsur,  had  226  demands  and  cost  $13,847.  Only 
11  out  of  the  2J2  parts  had  more  demands.  The  most  expensive  part,  a 
servo-control  assert>ly,  cost  $36,815.  There  were  10  demands  for  It. 
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Following  our  routine,  we  unde  monthly  predictions  for  a  yean:  in 
the  future  with  each  of  the  techniques  beuted  on  one,  two,  three,  etc., 
up  through  21  months  of  ei^rlence,  using  the  recorded  number  of 
flying-hours  as  the  measure  of  eurtlvlty  for  making  the  forecasts. 

There  were  21  sets  of  predictions  for  eaich  pcurt  using  Techniques  I-IV, 
substamtladly  fewer  for  V  and  VI,  and  only  4  for  Technique  VII  beoanise 
of  the  large  amount  of  cadculatlon  Involved. 

For  each  set  of  predictions,  we  computed  the  three  measures  of 
accuracy:  the  averaige,  relative,  and  root  mean  squaoe  errors.  These 
were  then  used  to  select  the  preferred  techniques  using  the  criteria 
described  in  the  preceding  section. 

Parts  which  had  no  Demands  in  the  First  21  Months 

There  were  7D  parts  in  the  sangple  that  haid  no  deimuids  in  the 
first  21  months .  Thirty-five  were  engine  coogponents .  Demands  rauiged 
from  1  to  113  during  the  last  12  months.  The  question  aurises:  Cam 
we  medBe  satlsfatctory  predictions  for  a  yearn  in  the  future  for  such 
parts  with  our  techniques?  Bach  monthly  prediction  is  siiqply  a  con¬ 
stant  imiltlplled  by  the  ratio  of  that  isonth's  flying  activity  to  the 
activity  in  the  experience  period.  For  Technique  I,  zero  demamd 
experience  gives  zero  demand  prediction,  regardless  of  the  amo\mt  of 
activity.  For  Technique  II,  zero  demand  gives  3.00(f/F)  am  the  pre¬ 
dicted  vatlue;  for  Technique  III,  2.72(f/F);  and  for  Technique  IV, 
3.86(f/F).  TeehniqittBs  V,  VI,  and  VH  cannot  be  used  for  these  perts, 
of  course. 

At  the  end  of  the  2l8t  month,  the  flying-hour  ratio  (f/F)  for 
predicting  the  ensuing  yeaur  is  about  0.82  for  the  17$  paurts  which  were 
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applicable  to  all  series  of  B-52*s.  The  fl7iiig-hour  ratio  is  different 
for  parts  with  limited  applicability  but  is  less  than  one  in  all  cases* 
Hence  Technique  IV,  which  gives  the  greatest  upper  bound,  yields  a 
predicted  value  of  about  3  units* 

We  examined  the  average  monthly  errors  for  these  70  parts  and 
selected  preferred  techniques  in  accordsince  with  the  criteria  discussed 

above*  Table  7  summarises  our  results* 

Table  7 

NUMBER  OF  PARTS  BY  PREFERRED  TECHNIQUE  AND  PROPERTY  CUSS 
(70  Parts  with  No  Demands  in  First  21  Months) 


Property  Class 

f 

technique 

Total 

I 

1 

II 

III 

IV 

Engine 

•••• 

1 

i 

1 

34 

35 

Airframe 

— 

— 

— 

1 

1 

Gunnery 

— 

— 

— 

5 

5 

Fire  Control 

1 

— 

1 

5 

7 

Communications 

8 

— 

1 

7 

16 

Accessories 

_2 

_4 

_6 

Total 

11 

.-L  . 

-JL 

70 

Our  previous  discussion  anticipated  the  large  number  of  parts 
for  which  Technique  IV  is  preferred  —  56  out  of  70,  or  80  per  cent* 

For  the  remaining  14  parts,  this  same  technique  is  preferred  for  the 
last  two  or  three  prediction  sets  except  for  two  of  the  communications 
parts*  One  of  these  had  only  one  demand;  it  occurred  in  the  29th  month* 
The  other  had  only  two  demands;  they  occurred  in  the  33rd  month* 

To  have  zero  demands  for  a  part  during  a  number  of  months  while 
it  is  exposed  to  many  thousands  of  flying-hours  is  information  that 
should  not  be  ignored*  Such  parts  may  be  like  the  6500  very- low-demand 
items  that  were  not  eligible  for  inclusion  in  our  sample,  or  they  may 
be  like  the  70  studied  here,  some  of  which  ultimately  had  a  large 
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inDA)er  of  degamds.  If  they  are  like  the  foneer.  Technique  I  la  pre- 
fexred,  hut  If  they  axe  like  the  latter.  Technique  IV  la  better.  In 
fcneral.  We  do  not  know  vhat  the  future  demand  pattern  will  be  for 
any  given  part  experiencing  a  nuaiber  of  nontha  of  zero  deiaand.  If 
ve  want  to  uae  Technique  I,  which  alwaya  predicta  zero  for  auch  peurta, 
a  prediction  period  ahorter  than  one  year  --  any  three  or  alz  montha  — 
ahould  be  \ised,  ao  that  we  can  ahlft  to  another  tediniqye  aa  eoon  aa 
aome  demands  occur.  If  thla  appeara  advlaable. 

Parta  having  Won-Zero  Deaiand  In  Flrat  21  Months 

There  were  202  parts  In  the  saiiq>le  which  had  some  denand  during 
the  first  21  months.  The  preferred  techniques  were  selected  In  accor¬ 
dance  with  the  procedure  outlined  earlier.  We  did  not  permit  shifts 
from  one  non-aervlce-llfe  technique  to  another,  nor  tram  one  service- 
life  technique  to  another,  but  only  between  the  two  groups.  For 
exanple,  even  when  It  seeamd  best  to  shift  from  Technique  IV  to 
Technique  I  at  a  certain  point  In  time,  we  did  not  allow  such  a  shift, 
but  selected  that  technique  which  had  the  smallest  AME  amst  of  the 
time,  beginning  with  the  12th  month.  There  are  some  parts  for  which 
we  would  uae  a  non-aervlce-llfe  technique  until  enough  data  had  aociau- 
lated,  and  then  shift  to  a  service-life  technique.  Qenerally,  the 
latter  could  not  be  used  until  about  the  15th  or  iBth  month.  This 
Implies  that  If  a  part  has  service-life  Oharaeterlstleo,  It  tehee  a 
long  time  for  Ite  flsmanfl  history  to  reflect  this. 

Simmagy  of  Preferred  Techniques  for  8aM?le  Barts 

Table  fid  steemurlzes  the  results  for  the  202  parts  whieh  had  at 
least  one  dCMnd  In  the  first  21  months.  SShls  8B  glwss  the  results 
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for  all  272  parts  in  our  sample.  It  is  obtained  by  adding  the  eorres- 
ponding  cell  entries  from  Tables  7  smd  8A. 

Table  8 

NUMBER  OF  PARTS  BT  PREFERRED  TECHNIQUE  AND  PROPERTY  CIASS 
A.  202  Parts  with  at  Least  One  Demand  in  First  21  Months 


Property  Class 

Technique 

Total 

I 

II 

Ill 

IV 

n 

VI 

VII 

Engine 

8 

„ 

u 

H 

B 

12 

Airframe 

23 

6 

3 

7 

1 

D 

44 

Gunnery 

10 

3 

5 

16 

4 

H 

41 

Fire  Control 

11 

n 

6 

2 

mm 

2 

31 

Communications 

17 

2 

2 

mm 

32 

Accessories 

16 

■I 

J 

J 

m 

— 

A2 

Total 

85 

un 

25 

LwJ 

JL 

16 

2 

202 

B.  All  272  Parts  in  the  Sample 


mgine 
Airframe 
Gunnery 
Fire  Control 
Ccmanunicat  ions 
Accessories 

Total 


8 

— 

5 

34 

23 

6 

3 

8 

10 

3 

5 

21 

12 

B1 

12 

25 

M 

10 

il 

H 

U 

96 

UtJ 

28 

47 

1 

— 

45 

4 

— 

46 

2 

2 

38 

2 

~ 

48 

-5 

46 

Ok. 

LiLJ 

2 

Our  analysis  of  the  202  parts  showed  that  for  several  of  them  it 
was  preferable  to  use  a  non-service-life  technique  first  and  then 
shift  to  a  service-lift  technique.  In  such  cases  we  allocated  the 
part  to  the  latter  in  Table  8A.  The  point  in  time  at  which  the  shift 
should  be  made  varied  from  part  to  part;  but  in  general,  the  service- 
lift  technique  was  preferred  as  soon  as  enough  demands  had  occurred 
for  it  to  be  used. 
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Table  BA  shows  us  that  no  single  technique  is  preferred  for  all 
the  parts.  Technique  I,  the  issue-rate  technique  the  Air  Force  now 
uses  to  predict  demands,  is  best  for  8^  peurts  (k2  per  cent) ,  more 
than  for  any  other  single  technique.  The  next  largest  is  Technique  IV 
with  43  parts,  or  21  per  cent.  Techniques  I-IV  account  for  17D  peurts, 

84  per  cent  of  the  total  of  202.  Taken  together  then,  the  constant- 
demand-rate  techniques,  which  are  the  cheapest  to  vae,  axe  preferred 
for  the  vast  majority  of  the  parts  in  our  sample  of  Hi-Valu  cod  Cate¬ 
gory  II  recoverable  parts  having  some  demand  diirlng  the  first  21  months. 
Techniques  V-VII,  which  assume  that  demand  is  related  to  age,  were 
best  for  32  peu:*ts.  The  first  two  of  these  were  preferred  for  about 
the  same  n\imber  of  parts.  Actuarial  Technique  VII  was  best  for  only 
2  peurts.  This  suggests  that  the  Air  Force  should  examine  very  care¬ 
fully  any  items  for  which  service-life  prediction  techniques  are 
being  considered,  in  order  to  determine  if  the  added  loprovement  is 
worth  the  cost  of  coUecting  the  necessary  data  and  making  the  compu¬ 
tations. 

Table  8B  gives  the  nurider  of  parts  by  preferred  technique  and 
property  class  for  all  272  parts  in  the  saiiple.  Techniques  I  and  IV 
are  preferred  for  about  the  same  number  of  parts,  9^  (35  per  cent) 
end  99  (36  per  cent)  respectively.  The  pcurts  having  no  demands  in 
the  first  21  months  of  the  data-coUection  period  account  for  the 
lange  increase  in  the  preferences  for  Technique  IV. 

We  selected  our  saaple  of  272  parts  from  those  in  the  original 
population  which  had  9  or  more  demands  during  the  33-menth  period. 

About  6900  part  nu^rs  had  fewer  than  5  deaads  and  were  thus  not 
eligible  for  the  saaple. 
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Since,  at  the  beginning  of  a  program,  the  Air  Force  predictor 
does  not  always  know  whether  there  will  be  a  large  or  small  n\adt>er  of 
demands  for  a  particular  line  Item,  the  best  he  can  do  is  use  engineer¬ 
ing  and  clitss  knowledge  for  the  predictions.  The  contlnml  maintenance 
of  an  accuracy  measure  showing  how  well  his  predictions  are  meeting 
actual  demand,  however,  might  suggest  points  In  time  when  he  could 
change  to  a  statistical  technique.  Furthexmore,  predicting,  say,  for 
three  or  six  months  Instead  of  a  year  would  make  the  selection  of 
another  technique  more  sensitive  to  the  occurrence  of  demands. 

appucahob  to  missile  data 

Our  next  point  of  discussion  concerns  the  application  of  the  pro¬ 
cedures  to  the  Falcon  missile  data.  We  had  Information  on  the  recorded 
failures  of  27  relatively  expensive  coiqponents  of  the  missile  over  a 
26-month  period  from  May,  193$  through  June,  1937*  The  data  cover 
about  6,000  missiles. 

The  smallest  number  of  recorded  failures  for  emy  one  component 
during  the  26-month  period  was  one  end  the  largest,  about  1,900.  The 
total  nunher  of  failures  on  all  27  conponents  exceeded  8,700,  with 
92  per  cent  of  them  occurring  during  the  last  year,  l.e«,  tram,  months 
13  throu^  26. 

Fewer  than  200  missiles  were  In  the  system  during  the  first  ten 
months.  The  nuid)er  then  built  up  rapidly  to  a  peak  of  about  2,900 
at  the  end  of  the  22nd  month;  tram  that  point  on,  it  dropped  each 
month. 

During  the  data-reportlng  period  the  silnslles  were  subject  to 
approodmately  30,000  checkouts .  The  checkout  program  built  up  much 
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slower  them  the  B-52  flylng>hour  program.  Only  1,000  eheekouts  were 
performed  during  the  first  six  montha,  about  2,400  by  the  end  of  the 
twelfth  month,  and  3f5O0  by  the  end  of  the  fourteenth  sionth,  when  the 
last  predictions  for  a  year  In  the  future  were  made.  Of  the  total 
checkout  activity,  86  per  cent  occxured  during  the  iMt  year  of  the 
data-coUectlon  program.  By  contrast,  per  cent  of  the  B-$2  flying- 
hour  program  took  place  during  the  last  year . 

A  checkout  was  used  as  the  program  element  In  making  predictions. 

It  Is  more  meaningful  than  operational  time,  which  Is  usually  small  — 
only  about  ten  minutes. 

As  with  the  B-^2  peurts,  we  used  data  cumulated  to  the  end  of 
each  month  to  make  monthly  predictions  for  the  ensuing  year  for  each 
cosgponent  with  each  of  the  applicable  techniques.  Vte  then  computed 
the  measures  of  accuracy  and  selected  a  preferred  technique  for  each 
component.  Only  10  of  the  27  cong;>onents  had  enough  failures  so  that 
aJLl  seven  techniques  could  be  applied  to  them.  The  first  six  techniques 
were  used  on  J  coiqponents,  and  only  the  first  four  on  the  remaining 
10.  This  gave  us  l4  sets  of  predictions  for  each  coeiponent  using 
Techniques  I,  II,  III,  and  IVj  fkasi  2  to  l4  sets  using  Techniques  V 
and  VI,  depending  on  the  nuniber  of  failures;  and  four  sets  for  Technique 
VII.  This  last  Is  due  to  the  fact  that  we  made  predictions  with  the 
actuarial  technique  at  the  end  of  the  9th,  12th,  13th,  and  l4th  months 
only.  There  was  too  much  eoagiutatlon  Involved  to  make  predictions  at 
the  end  of  each  month.  Table  9  shows  the  nxmber  of  coiVOBsnts  by 
preferred  technique  and  general  characteristics. 
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Table  9 

NUMBER  OF  COMPONENTS  BY  PREFERRED  TECHNIQUE 
AND  GENERAL  CHARACTERISTICS 


General 

f 

rechn] 

LQue 

Characteristics 

I 

■9 

VI 

Total 

Electronic 

2 

6 

■ 

m 

9 

Electrical-mechanical 
Mechanical  with  no 

3 

7 

H 

9 

10 

moving  parts 

6 

El 

|9 

1 

7 

Unknown 

H 

H 

Total 

11 

1  ^  1 

1  ^ 

1 

27 

Baaed  on  this  table,  ve  can  examaarlze  our  restilts  for  the  Falcon 
niselle  as  foUowe:  Technique  I  is  preferred  for  coqponents  uhich 
are  chiefly  mechanical  with  no  moving  parts;  upper-bound  Technique  IV 
is  preferred  for  electronic^  electrical,  or  mechanical  components. 
These  results  should  not  be  understood.' tb'  mean  that  tqpper-bound  Tech¬ 
nique  IV  offers  a  si^rior  forecasting  method  for  electronic  pcurts 
as  such.  There  are  indications  that  the  good  shoving  of  this  method 
in  the  present  study  resulted  tram  the  accelerated  phase-in  of  the 
Falcon  missile  during  the  period  in  question,  which  tended  to  turn  a 
declining  dwnil  rate  per  cheekout  into  an  increasing  linmanil  rate  per 
month. 

We  were  able  to  make  a  more  detailed  analysis  of  the  Falcon  com¬ 
ponents  than  the  B-32  parts  because  of  their  smaller  number.  We 
examined  the  constant -fail\xre -rate  assuaptlon  of  Techniques  I-IV  and 
found  it  valid  for  only  10  of  the  27  coavonents.  Technique  I  was 
preferred  for  7  of  these  and  IV  for  the  rmaainlng  3*  Boms  of  the 


33 


other  conqponents  showed  evidence  of  ecnstent  but  different  failure 
rates  during  different  portions  of  the  data>eollectlon  period.  We 
found  significant  linear  relationships  between  the  monthly  nusibers 
of  failures  and  checkouts  for  22  of  the  27  caqponents .  They  were 
only  of  limited  value,  however,  for  prediction  purpoeee  because  of 
the  imay  unknowns  Involved. 

nroiHGS  AMD  COHOmSIOWS 

(1)  No  one  techniq;ue  was  preferred  for  all  parts  and  tlsie 
periods  In  our  saiqple  of  B>^2  pcurts,  or  for  the  Feicon  components. 
Technique  I  was  preferred  for  96  parts  In  the  saiqple,  IV  for  99 
parts.  Technique  I  wM  also  preferred  for  the  Falcon  coiqponents  that 
are  mechanical  with  no  moving  parts.  However,  Technique  I  underestl- 
sntes  much  of  the  time,  especially  In  the  early  months  of  the  program. 
If  an  overestimate  Is  more  desirable  than  an  underestimate.  Technique 
I  would  not  be  preferred  for  as  mxny  psurbs;  we  would  then  prefer  to 
use  one  of  the  upper-bound  techniques. 

For  those  parts  for  which  a  service-life  technique  was  preferred 
during  the  later  portion  of  the  time  period,  there  Is  no  uniformity 
as  to  which  non-servlce-Ufe  technique  should  be  used  during  the 
early  portion  of  the  program. 

(2)  A  large  n\]aiber  of  peirts  will  be  exposed  to  msny  months  of 
operation  before  any  desmnds  are  observed.  This  fact  of  course  does 
not  guarantee  zero  demands  In  futiure  SKinths.  Thus,  our  sample  of 
B-$2  parts  Included  TO  which  had  no  demands  during  the  first  21  months. 
During  the  last  12  months,  flsnsnils  rangsd  tram  1  to  II3.  Of  the  27 
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IklcoD  ccnqponentB,  4  had  no  dannadB  during  the  first  ik  aaoths*  But 
they  had  densnds  of  1,  k,  4,  and  6o  during  the  laet  12  aonthe. 

IDechnlque  IV  vae  preferred  for  36  of  the  70  B-52  peurbe  and  for 
the  falcon  ceafponent  vhleh  had  60  demands  In  the  last  12  laonths. 
Deehnlque  I  vas  preferred  for  11  of  the  B-^2  parte  and  the  remaining 
3  falcon  ceaqponente.  Technique  III  was  preferred  for  3  B-52  parts. 

(3)  The  Issue-rate  technique  has  most  general  appUcablllty. 

Our  B-32  saiqple  was  selected  from  those  part  nvaA>er8  which  had  at 
least  5  demands  during  the  33  month  data  collection  period.  There 
were  about  630O  part  nunbers  with  4  or  fewer  demands.  The  demand 
rates  for  these  parts  would  be  low  and  there  would  be  a  number  of 
months  of  zero  demand  experience.  Issue  rate  Technique  I  always  pre¬ 
dicts  zero  when  experience  Is  zero,  and  would,  be  preferred  for  such 
parts  according  to  our  criteria.  As  soon  m  some  demands  occur,  how¬ 
ever,  It  would  underpredlct  and  an  upper-bound  technique  would  be 
better.  If  we  want  to  use  Technique  I  for  very  low  demand  parts, 
predictions  should  be  made  for  less  than  a  year,  say  for  three  or  six 
months,  so  that  a  shift  to  another  technique  can  be  made.  If  advisable, 
as  soon  as  sosm  demands  occur. 

It  should  also  be  pointed  out  that  the  Issue-rate  technique  Is 
the  least  expensive  as  well  as  the  slnplest  technique  to  use.  Any 
added  li^provemant  In  the  predictions  made  by  one  of  the  other  techniques 
may  not  be  worth  the  additional  cost.  This  possibility  would  have  to 
be  examined  for  each  part,  for  the  very  low  demand  Itesm,  Techniques 
II  or  IV,  which  are  the  most  expensive,  may  overpredict.  Nevertheless 
their  added  cost  may  be  worth  It  In  terms  of  avoiding  shortages.  Again, 
such  decisions  would  have  to  be  made  on  a  part-hy-part  basis. 
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(4)  Despite  the  fact  that  nemy  parts  seemed  to  have  Increasing 
demand  rates,  ve  were  not  able  to  identify  any  group  for  which  the 
service-life  techniques  were  preferred  during  the  time  periods  for 
which  we  had  data.  For  those  parts  where  a  service-life  technique 

was  preferred,  the  preference  was  V  or  VI.  Technique  VII,  the  actuarial, 
method,  was  preferred  for  only  2  of  the  12  B-52  parts  and  for  1  of  10 
Falcon  coiqponents  to  which  it  was  applicable.  This  lsq)lieB  that  the 
Air  Force  should  examine  very  carefully  those  items  being  considered 
for  the  application  of  service-life  techniques.  They  eore  eiq^enslve 
to  use  and  the  liqprovement  in  accuracy  may  not  be  worth  the  Incireased 
cost. 

(5)  There  will  always  be  prediction  errors  regardless  of  the 
technique  used  or  the  eiqperlence  accumulated.  In  this  study,  even 
when  the  preferred  technique  was  used  for  each  psurt  or  groiq>  of  parts, 
many  errors  were  large. 

(6)  Regsu^ess  of  \dilch  technique  is  used,  a  meeisure  of  its 
eiccuracy  should  be  maintained.  The  aversige  monthly  error,  the  rela¬ 
tive  error,  the  root  mean  square  error,  or  some  other  measure  could 
be  used,  depending  upon  the  desired  objective.  Continual  examination 
of  this  measure  would  give  a  better  indication  of  how  well  the  tech¬ 
nique  hsis  been  predicting  and  suggest  points  in  time  at  which  changes 
to  another  technique  might  be  desirable. 
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ON  THE  USI  OF  THB  OittMA  lUNCTION  IN  OMAND  FREDICnOH 

Jules  Silver 

Air  Force  Logistics  Caonaaiid 

I  would  lUse  to  describe  some  worli  done  by  the  Operations  Analysis 
Division  of  the  AF  Logistics  Command.  It  concerns  the  \ise  of  the 
Qamma  distribution  to  inredlct  demaisd.  This  work  was  undertaken  to 
explore  the  possibility  of  developing  a  relatively  inexpensive  pre¬ 
diction  technique  for  Hl-VeQ.u  Items,  which  would  yield  results  at 
least  comparable  In  accuracy  to  those  obtained  by  computationally 
expensive  techniques  such  as  the  actuarial  method. 

In  order  to  make  sure  that  we  have  agreement  on  definitions,  I 
shall  define: 

(1)  Survivor  Distribution  (Percent  Surviving  Table)— the  proba¬ 
bility  that  an  Item  of  age  zero  will  not  have  failed  by  age  t. 

(2)  Time -to -Failure  Distribution  (Percent  Falling  Table)— 
the  probability  that  an  item  will  fail  between  age  t  and  t  +  1. 

NOTE:  This  distribution  can  be  derived  from  the  survivor  distribution 
by  differencing  the  successive  probabilities . 

(3)  Failure  Rate— the  (conditional)  probability  that  an  Item  of 
age  t  will  fall  during  the  Interval  t  to  t  1.  This  Is  derived  by 
dividing  the  time  to  failure  pirobablllty  at  t  1  by  the  probability 
of  surviving  to  time  t. 

(4)  Removal  Distribution— the  probability  of  J  removals  In  soew 
interval  of  length  T,  when  failed  Items  are  replaced  with  items  of 
zero  age. 


Urli^t-Pattereon  Air  Fbree  Base 
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(5)  Exp«ct<d  Del— ni  Curve— the  eiqpeeted  xnodMr  of  ronovals  occur- 
ring  in  a  specified  interval  of  time. 

The  OoBaa  distribution  of  order  n  is: 

n+1  .  n  -6t 

m  -  »  *.  • 


and  represents  the  tine -to -failure  distribution.  The  Qenma  distri¬ 
bution  of  order  zero  Is  equivalent  to  the  exponential  distribution. 

It  can  be  shown  that  the  removal  distribution  equivalent  to  the 
"Gkuoaa-zero"  is  the  Poisson  and  we  shall  call  the  removal  distribution 
for  the  higher  order  Gammas  "the  Hyper -Pols son." 

The  issue  Interval  technique  for  predicting  demand  is  one  in 
which  future  demands  are  estimated  by  multiplying  the  ratio  of  future 
program  to  past  program  by  the  Issues  during  the  put  program.  This 
technique  yields  results  equivalent  to  that  derived  when  the  time-to- 
fallure  distribution  is  exponential  (constant  failure  rate)  or  where 
the  population  is  mature  so  that  the  age  distribution  is  stable.  How¬ 
ever,  the  issue  interval  technique  does  not  give  "good"  results  where 
the  failures  are  age  related,  and  the  poinilatlon  is  not  nature. 

The  actuarial  method  predicts  removals  by: 

(a)  cemoputing  the  failure  rates  and  applying  them  to  the  ages  of 
items  in  the  inventory  or; 

(b)  deriving  an  average  life  from  the  failure  rates  and  using  it 
in  a  similar  way  to  the  issue  Interval.  We  will  call  this  the  "single 
factor"  technique. 

method  takes  advantage  of  a  family  of  dis¬ 
tributions  uhi^  are  quite  versatile,  and  easy  to  ■athamaticaUy. 
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nie  Geuana  function  Is  translated  by  means  of  the  removal  distribution 
Into  an  esqpected  demand  curve  and  an  Iterative  procedure  Is  used  to 
find  the  best  fit  to  the  actual  demand  curve  (cumulative  demand  vs. 
cumulative  program)  by  a  least  squares  technique.  In  effect,  this  Is 
a  method  of  finding  the  parameters  ^and  n  that  give  the  best  fit. 

As  additions!  actual  data  Is  generated,  the  computer  program  adjusts 
the  prediction. 

A  Monte  Carlo  model  Initially  tested  the  technique .  An  Item  with 
300  hours  average  life  and  600  hours  maximum  life  (msuidatory  remove!) 
was  synthesized.  13ils  Item  was  used  on  aircraft  In  12  squadrons  of 
23  aircraft  eeich,  with  squadrons  phaslng>ln  during  a  period  of  $ 
quarters .  Hying  hours  for  each  alrcrs!t  were  randomly  generated 
with  an  average  of  20  hours  per  month  per  airezuft  but  varying  between 
0  and  40. 

The  failures  were  generated  from  a  "uniform"  tlme-to-fallure 
distribution  (l.e.,  constant  probability  of  failure  from  sige  0  to 
mandatory  removsd) .  nils  gives  failure  rates  which  fu>e  low  and  unl> 
form  during  the  early  ages  but  rise  very  rapidly  during  the  older  agae . 
The  uniform  tlme-to-fallure  distribution  was  selected  because  It 
appeared  so  lulllce  any  Gamma  distribution. 

HVo  forecasts  were  made,  each  for  12  months  In  the  future;  one 
after  12  months  of  "actual"  data  and  one  after  18  months  of  "actual" 
data.  Predictions  were  made,  not  only  using  Gamna,  but  also  "Issue 
Interval,"  and  actuarial  (full  table  and  single  factor).  Table  1 


shows  the  results. 


40 


Table  1 

lORBCASTS  USING  12  AMD  18  NOmiHS  OF  ”AC!!RJAL"  DATA 


Item 

12  Months 
Experience 

18  Months 
Eiqperlence 

Demand 

Error 

Demand 

Error 

Actual 

176 

242 

Actuarial  (Full  Table) 

3OT 

+  74^6 

205 

-  ^5* 

Actuaries.  (Single  Factor) 

344 

+  93i 

226 

-  ,7* 

Issue  Interval 

120 

-  32* 

144 

-  40* 

Qanma 

211 

+  20* 

253 

+  5* 

With  only  12  months  of  data,  the  actuarial  methods  made  poor  forecasts . 
After  18  months,  the  denand  predictions  were  good.  The  Issue  Interval 
technlq[ue  was  inadeqmate  In  both  cases,  since  the  population  had  not 
matured. 

The  Qanma  method  worked  well  In  both  cases,  and  this  provided 
the  Impetvis  for  addltloneLL  work.  Subsequently,  a  set  of  tlme-to- 
fall\ire  distributions  was  attained  for  13^  Items  covered  by  the 
actuarial  method.  The  distributions  appeared  to  vary  quite  widely. 

The  Qanma  method  was  used  to  predict  demand,  and  a  coisparisen  made 
with  the  predictions  obtained  by  use  of  the  actuarieil  technique.  The 
resiilts  showed  the  differences  to  be  of  the  order  of  1$  per  cent  or 
less . 

The  e:qploratlon  of  the  Gamma  technique  described  above  has  not 
been  conq>leted  for  a  variety  of  reasons .  It  should  be  pointed  out 
that  the  computational  requirements  for  the  gamma  technique  are  not 
Inconsequential,  although  they  appear  to  be  less  than  those  of  the 
actuarial  technique.  In  addition,  there  are  many  Hl-Valu  Items  which 
have  a  very  long  service  life.  This,  la  effect,  would  result  In 
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fitting  a  zero  order  function  (vhleh  is  equlvedent  to  the  isstie  inter¬ 
val)  during  much  of  the  early  life,  since  the  technique  would  not  be 
sensitive  enou^  to  detect  the  changing  rates .  On  the  other  hand, 
very  short  service  life  items  mature  quickly  and  the  issue  Interval 
approach  would  be  satisfactory.  However,  it  is  felt  that  the  technique 
is  useful  for  Hl-Valu  items  with  mid-range  service  life;  aad  additional 
work  in  developing  techniques  is  indicated. 
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A  atMUm  OF  THE  LOGISTICS  RESEARCH  FRMECT'S  EXFERZSRCI 
Wm  FROBUtS  OF  DBfAHD  FREDICTIOR 

Heziry  Solonon 

nie  George  Washington  University 

The  Logistics  Research  Project  has  been  concerned  with  problems 
of  demand  prediction  for  about  12  years .  This  Is  due  to  the  slgnlfl* 
cance  of  demand  behavior  6tnd  ixredlction  for  the  many  logistics  problems 
which  have  been  topics  of  research  at  the  Project  during  this  time. 

To  describe  In  about  30  minutes,  the  hinds  and  results  of  work  done 
on  the  subject  of  demand  prediction  requires  that  even  some  major 
aspects  and  results  must  be  Ignored.  It  Is  also  necessary  to  Ignore 
the  particular  context  of  logistics  problems  and  model  formulations 
for  which  the  various  aspects  of  demand  prediction  were  studied.  The 
following  discussion  consists  of  a  few  of  the  major  hlc^lghts  of 
studies  of  demand  behavior  euid  prediction. 

It  should  be  noted  that  the  comments  to  follow  will  be  restricted 
to  problems  of  demand  prediction  for  detailed  line-items  which  are 
particularly  significant  for  many  topics  which  may  be  placed  under  the 
general  label  of  military  Inventory  problems.  Also,  while  there  are 
differences  between  the  problem  of  predicting  failure  vs .  predicting 
demand  or  usage,  for  the  sake  of  brevity  these  will  be  iffxxred  In 
the  following  discussion. 

One  early  major  formulation  of  the  demand  problem  was  mostly 
concerned  with  the  determination  of  operational  variables  as  program 

« 

Work  performed  In  connection  with  the  University's  Logistics 
Resssreh  Project,  Contract  Ronr  761(0$),  Project  HR  047  001. 


44 


elements  for  xxsage .  To  q^ote  ToiiQdclns ,  ,  the  tissge  problem  Is 

shout  as  foUovs:  To  determine  a  minimal  number  of  Independent 
operational  variables  upon  vhlch  the  usage  of  a  commodity  depends 
and  to  convert  operational  plans  Into  the  non-recurring  quantities 

tt(l)* 

of  conmodltles  required  and  Into  the  time  rate  of  recuxrlng  demands.  ' 
This  did  not  mean  that  problems  are  limited  to  the  Identification 


of  these  variables.  Rather,  once  these  were  found,  the  problem  vas 
to  account  for: 

(1)  Deviations  from  predicted  operations, 

(2)  Deviations  in  average  usage  rates  for  medntenance  and 
overhaul,  from  station  to  station,  and  from  time  to 
time  (l.e.,  variations  In  procedures  by  technicians, 
variations  caused  by  aging,  development  of  better 
materials,  etc.),  and 

(3)  Deviations  of  actual  usage  rates  around  expected  usage 
rates  during  operations .  (l>2-5} 

During  the  years  1949-^2,  some  atteoqpts  were  made  to  study  these 
questions  as  well  as  some  others,  mostly  as  a  oonseqaaiice  of  the 
formulation  of  Inventory  models. 

Attempts  to  verify  and.  In  fact,  even  In  those  early  days,  to 
sliailate  these  models,  met  a  significant  barrier;  namely,  the  availa¬ 
bility  of  demand  data.  As  a  result  of  extreme  paucity  of  Information 
with  vhlch  to  Investigate  the  many  facets  of  demand  behavior,  a  large 
scale  usage  data  collection  program  was  Initiated  by  the  Froject.^^^^*^^ 
Since  this  program  generated  what  probably  stands  as  the  largest  body 
of  demand  data  In  existence,  a  few  rsasriGS 
this  program  are  In  order. 


See  pegs  14  of  Ref.  1. 


osnesmlng  the  iia.tur«  of 
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The  objective  was  to  collect  data  representing  usage  by  and  on 
account  of  6^  ships .  Ihat  Is ,  to  collect  data  on  material  used  for 
end'vme  by  each  ship,  euid  material  used  for  end-use  by  supporting 
Mtlvltles  such  as  shipyards  performing  maintenance  and  overhaul  on 
these  ships,  tenders,  etc.  lOils  6^  ship  ssople  included  various 
classes  and  types  of  ships,  e.g.,  carriers,  destroyers,  submarines, 
etc.  The  data  pertained  to  usage  of  all  Items  other  than  categories 
such  eis  food  and  clothing.  It  Included  eLLl  mechazilcal  and  electrical 
parts,  clU  electronics  parts,  all  ordnance  parts,  and  all  ganeral 
stores  material. 

While  the  tnnaber  of  ships  Included  In  the  sample  was  reduced 
over  time,  the  program  covered  data  extending  over  a  6  year  period 
beginning  In  June  19^0.  For  a  very  small  number  of  ships,  an  addi¬ 
tional  time  period  Is  available  resxiltlng  from  a  later  research  pro¬ 
gram  referred  to  as  the  "Allowance  List  Test  Program." 

A  large  amount  of  experience  and  Insights  were  gained  In  the 
problems  of  data  collection  and  data  processing.  However,  these 
will  not  be  discussed  here.^^^^^^  While  this  program  was  underway, 
of  course  considerable  thou^t  was  given  to  exactly  how  these  data 
should  be  used  for  analyses .  Many  such  specifications  were  made  prior 
to  availability  of  the  data  for  such  analyses  These  Included 

many  of  the  topics  mentioned  on  the  agexida  for  this  meeting,  e.g., 
distribution  studies  of  various  kinds,  types  of  activity 
analyses  essentially  Involving  the  behavior  of  usage  related  to  opera¬ 
tional  variables,  time  series  analyses,  etc. 

« 

Viulous  papers  appearing  In  Ref.  9* 
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In  19^;  some  smedl  scale  Investigations  were  atteoqpted^  mostly 
Involving  the  search  for  meaningful  operational  variables.  The 
results  of  these  were  mostly  negative.  That  IS;  the  operational 
variables  en^loyed  (e.g.,  hours  Tinderway,  engine  miles  steamed,  war¬ 
time  operations  vs.  peace  time,  etc.)  could,  not  be  significantly 
related  to  usage.  This  was  the  first  positive  indication  that  the 

demand  prediction  problem  would  be  anything  but  straightforward. 

(12) 

However,  again  these  were  beuied  on  modest  amounts  of  data.'  ' 

In  19^  a  working  conference  sponsored  by  the  Project  and  the 

(9) 

Office  of  Naval  Research  was  held  on  the  subject  of  usage  data.'*' 

From  this,  many  proposcLLs  were  offered  in  the  areas  of  data  collection, 
data  reduction,  and  the  xises  and  analyses  of  usage  data  for  logistics 
problems .  This  is  mentioned  because  many  of  the  conclusions  and 
proposals  probably  still  apply. 

The  first  major  study  of  demand  behavior  by  the  Project,  and  in 
cooperation  with  the  Bureau  of  Supplies  and  Accounts ,  vaa  completed 

(la) 

in  1957'  This  study  employed  a  large  amount  of  data  and  had  a 

significant  Influence  on  events  to  follow.  The  context  of  this  study 

was  the  Allowance  List  Problem  or  that  of  determining  shipboard  stock 

levels.  Die  data  consisted  of  mechanical  and  electrical  parts  usage 

by  and  on  account  of  each  of  12  submarines  over  a  four  year  period. 

Die  study  also  included  the  use  of  operational  data  plus  a  new  and 

vital  piece  of  information,  namely,  population  data.  The  sioadflcanea 

of  these  population  data  will  be  explained  shortly. 

The  important  conclusions  from  this  study  were: 

(1)  No  significant  relations  were  observed  between  usage 
and  the  operational  variables  employed. 
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(2)  1!he  demand  for  Items  was  extremely  low  and  sporadic. 

Over  the  entire  four  year  period  for  each  submarine 
amd  its  supply  activities,  70  per  cent  of  the  items 
demanded  were  demanded  only  once.  Approximately  90 
per  cent  of  the  items  demanded  were  demanded  at  most 
twice,  etc.  lOiere  was  a  suxrrising  amount  of  con¬ 
sistency  among  the  12  vessels  as  to  frequency  of  events 
of  demand. 

(3)  However,  for  any  ship  the  range  of  Items  demanded 
differed  significantly  from  year  to  year.  That  is, 
almost  clLI  items  which  were  demanded  in  one  year  were 
not  demanded  in  another  year. 

(4)  VThile  these  12  vessels  included  three  sets  of  sister 
ships  there  was  extremely  little  commonality  of  items 
demauided  among  the  vessels.  That  is,  the  range  of 
items  demanded  for  each  ship  was  hlg^y  unique.  This 
indicated  that  broeidening  the  baise  by  including  more 
ships  may  have  little  effect  on  the  results . 

(3)  Finally,  and  most  important,  approximately  75  pcr 

cent  of  the  Items  in  the  population,  i.e.,  installed 
and  deemed  wearable,  were  not  demanded  at  all,  by  or 
on  account  of  each  ship  during  the  four  year  period. 

This  was  the  first  piece  of  major  evidence  demonstrating  the 
very  high  degree  of  \incertainty  of  demand.  The  major  problem  being 
the  very  large  number  of  items  deemed  wearable  but  not  used  at  all. 
Still  another  way  of  looking  at  the  problem  was  to  conclude,  that  for 
stocking  policies,  since  the  average  quantity  used  of  items  which 
were  demanded  was  also  very  low,  greater  emphasis  should  be  given  to 
range  considerations  than  to  depth. 

While  the  results  of  the  study  were  significant,  they  were  also 
negative.  Qiven  the  observed  hl^  degree  of  uncertainty  of  demand, 
in  particular  the  hic^ily  sporadic  nature  of  demand,  bow  to  handle  or 
control  this  condition  for  stocking  policies  was  considered  to  be  the 
most  important  problem. 

It  tras  this  condition  which  led  to  a  major  study  pertaining  to 

(Xk) 

maasurements  of  the  military  essentiality  of  repair  parts.'  '  Sinoe 
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the  range  as  well  as  the  depth  of  items  demanded  was  so  uncertain,  It 
was  then  decided  to  determine  whether  or  not  It  Is  possible  to  at  least 
select  that  range  of  Items,  which  independent  of  any  particxilar  demand 
chareicterlstlc ,  may  be  considered  essential  to  the  vessel's  mission. 

It  Is  interesting  to  note  that  these  observed  demand  characteristics 
led  to  this  particular  military  essentiality  study  rather  than  cuiy 
specific  Inventory  model  reqpilrlng  measurements  of  essentiality. 

This  study  proved  to  be  hlj^ily  successful  and  demonstrated  the  feasi¬ 
bility  of  obtaining  measures  of  relative  military  worth.  It  also 
showed  that  most  repair  parts  were  of  relatively  low  essentlcdity. 

'Ibis  military  essentiality  technique  has  recently  been  further  inqproved 
for  the  Polaris  program  and  is  In  process  of  implementation  for  the 
Polaris  logistics  system. 

The  demand  study  previously  mentioned  pertained  only  to  mechanical 
and  electrical  parts  \isage  for  submarines .  Ibere  was  still  some  con¬ 
jecture  that  while  these  patterns  may  be  true  for  these  types  of  parts, 
and  for  submarines,  one  would  not  observe  the  same  behavior  for  elec¬ 
tronics  or  ordnance  parts  in  submarines,  or  for  image  of  other  types 
of  repair  pcurts  for  surface  ships.  Additional  empirical  studies  were 
conducted  utilizing  electronics  and  ordnance  usage  data  for  submarines 
and  other  types  of  material  usage  for  other  type  ships The 
results  of  these  studies  confirmed  the  initial  study  for  mechonioal 
and  electrical  parts.  That  is,  again,  for  all  types  of  material, 
very  low  and  sporadic  usage  was  observed  and  the  ma^iltudes  were 
almost  identical  with  the  initial  study.  Ibese  studies  again  empha¬ 
sized  the  very  large  number  of  zero  movers  and,  in  tho  eaeo  of  tbooo 
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Items  which  were  denanded,  a  very  low  aoiount  of  demaods  azid  quantities 
demanded.  Again  while  these  results  were  significant  and  Included 
data  of  ell  types  studied  over  very  long  periods  of  time,  they  were 
negative.  Die  term  negative  implies  here  that  none  of  the  more  or 
less  strale^tforward  techniques  previously  considered,  weald  provide 
acceptable  resxilts. 

Earlier,  population  data  was  mentioned.  Since  this  proved  to  be 
a  slffilflcemt  piece  of  Information,  a  few  renarks  concerning  these 
data  are  necessary.  Population  data  refer  to  the  number  of  times  a 
part  Is  Instedled  In  a  component  and  the  number  of  times  that  component 
Is  Installed  In  the  vessel.  If  the  Interest  Is  In  terms  of  system 
usage  then,  of  course,  the  number  of  vessels  which  Include  the  com¬ 
ponent  should  be  accounted  for.  In  short,  these  data  provide  the 
"number  of  opportunities  for  usage."  Itaese  data  are  highly  significant 
but  surptrlslngly  difficult  to  collect.  With  the  availability  of  this 
Information  the  number  of  Itana  not  used  can  be  observed,  a  statistic 
too  often  unobtainable. 

!nie  second  major  aspect  of  population  data  is  that  one  may  wish 
to  assume  that  usage  of  an  Item  is  some  function  of  Its  population. 

In  fact  the  explicit  utilization  of  population  data  in  this 
resulted  in  one  of  the  most  promising  procedures . 

During  the  "AUowsnce  List  Test  Program,"  a  function  of  the 

(iq) 

population  was  used  as  a  usage  estimator  for  some  groups  of  Items.' 

In  this  program  some  very  simple  approaches  were  taken.  One  was  to 
consider  the  square  root  of  the  population  as  the  usage  estimator. 

Ibis  turned  out  to  be  as  good  an  estimator  as  any  other  prc  <edure 
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used  at  that  time.  Since  usa^  is  low  and  sporadic ;  en^loylng  this 
technique  did  tend  towards  overstocking,  but  for  the  simulations  used 
during  this  program,  this  estimator  was  used  only  for  the  hl^  worth 
Items  for  which  some  amount  of  overstocking  Is  preferable  to  under¬ 
stocking.  Without  going  Into  details  here.  It  should  be  stressed  that 
the  first  positive  res\xlts  occurred  by  considering  tisaige  e:qpllcltly 
as  some  function  of  population  for  prediction  of  demand. 

Also,  with  the  Allowance  List  Test  Program  came  some  other 
iaqortant  positive  Indications  about  the  possibility  of  Inqxrovlng 
dememd  predictions .  One  of  these  was  definite  evidence  that  utilizing 
usage  data  collected  from  some  past  period,  even  when  used  In  the  most 
Btral£d>tforward  manner,  provided  better  stock  levels  than  to  usage 
data  at  all  and  relying  solely  on  technician's  estimate  of  require¬ 
ments  .  In  simulating  future  time  periods  and  coiiq>arlng  amounts 
actually  stocked  by  technicians  versus  those  stocked  by  singdy  extrapo¬ 
lating  usage  and  comparing  both  with  entuad  usaige  In  these  futxire  periods, 
the  result  wats  that  a  great  reduction  In  the  range  of  Items  stocked  was 
Incurred  by  stocking  based  solely  on  usaige  without  Incurring  anywhere 
near  a  proportlonaLl  Increase  In  the  number  of  range  shortaiges.  Also, 
in  regard  to  meeting  quantities  demanded  of  any  particular  Item,  the 
procedure  of  utilizing  usage  data  provided  less  depth  shortaiges  than 
those  stock  levels  stimulated  by  technicians .  The  procedures  where 
solely  usage  data  were  \ised  to  predict  future  requirements  were  applied 
only  to  lt«iiB  with  "low  essentladlty."  This  inrocedure  tended  toward 
understocking,  however,  the  ratlonade  employed  was  that  these  were  low 
essentladlty  Items  and  In  these  caues,  some  amount  of  understocking 
Is  preferred  to  overstocking.  Another  point  worth  noting  is  that  by 
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Inclvidlng  data  from  all  sorirces  the  projections  based  solely  on  usage 
were  superior  to  those  for  which  only  ship's  own  use  was  employed, 
niat  is,  by  broadening  the  historical  bue  to  Include  all  activities 
using  material  on  account  of  each  ship  as  well  as  by  the  ship  Itself, 
the  predictions  for  demand  by  the  ship  Itself  In  the  future  were 
Inqproved. 

A  final  point  worth  noting  from  the  Allowance  List  Test  Program 
concerns  the  use  of  operational  variables .  It  definitely  appeared  that 
the  operational  variables  typlcedly  used  are  too  gross .  That  Is ,  to 
attempt,  for  exajiqple,  to  relate  eill  mechanical  and  electrical  parts  to 
"hours  uxiderway"  or  "engine  miles  steamed,"  etc.,  does  not  account  for 
the  particular  xises  of  the  comoponents  In  which  the  parts  are  Installed. 
That  Is,  for  exaoiple,  severed,  components  In  the  cetse  of  the  submarine 
are  used  only  when  the  ship  Is  diving  or  sturfaclng.  Hence,  It  ml£^t 
be  eoqpeeted  that  this  kind  of  operation  Is  what  would  affect  the  usage 
of  parts  In  these  oonqponents  axid  not  necessarily  the  number  of  hours 
\inderway,  etc.  All  that  can  be  sedd  at  the  moment  Is  that  the  search 
for  operational  variables  caxmot  be  said  to  be  closed.  Rather,  some 
mare  detailed  types  of  analyses  oust  be  performed  In  the  future. 

Recently  the  Project  has  been  undertaking  a  research  program  per¬ 
taining  to  the  logistics  system  for  the  Polaris  Weapon  System.  Incident 
to  these  studies,  the  problem  of  demand  behavior  Is  of  paramount  Issue. 
While  the  context  of  these  problems  cannot  be  described  here,  one  Impor¬ 
tant  requlirement  was  to  determine  the  demand  distribution  which  may  be 
engkloyed  with  a  technician's  estimate  of  average  usage.  Utilizing 
dnaad  data  ooUected  over  a  long  period  of  tine,  scan  atatlstleal 
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Invest IgationB  were  msde  to  determine  the  "goodness  of  fit"  tor  the 
negative  hlnomlaLL  and  Poisson  distributions.  Ilhe  result  of  these  tests 
was  that  the  line-item  demand  behavior  over  time  could.  In  the  great 
majority  of  cases,  be  described  by  the  negative  binomial  distribution. 
Sone  caution  oust  be  exercised  here  by  notlxig  that  the  Items  used  In 
these  tests  consisted  only  of  Items  which  were  used  or  the  population 
of  demands  and  not  the  population  of  Items  which  were  Installed  and 
deemed  wearable. 

In  a  recent  set  of  large  scale  simulations  for  Polaris  Allowance 
Lists  the  negative  binomial  distribution  was  used  with  a  partleular 
set  of  variance  to  mean  ratios  which  were  a  function  of  the  size  of 
the  mean  usage  estimate. 

The  negative  binomial  distribution  has  some  Interesting  properties 
which  are  currently  being  examined  more  closely  at  the  Project.  IMs 
pertains  to  the  effects  of  different  families  of  this  distribution  In 
terms  of  sets  of  variance  to  mean  ratios  for  particular  average  usage 
estimates  and  the  changes  In  stocking  due  to  changes  In  protection 
level.  These  different  families  of  the  negative  binomial  distribution 
are  also  being  studied  In  relation  to  other  demand  distributions . 

The  orientation  of  these  studies  Is  In  terms  of  particular  types  of 
inventory  problems .  A  great  deal  of  attention  Is  being  paid  to  the 
effects  of  the  vise  of  these  distributions  given  such  problems  as  deal¬ 
ing  often  with  extremely  small  mean  demands,  extremely  hlj^  protection 
levels,  etc.,  emd  at  the  same  time  considering  the  resulting  costs  and 
gains  in  the  partleular  Inventory  system. 

It  ml^t  also  be  mentioned  in  regard  to  the  Polaris  Program  that 
the  levy  is  actively  collecting  usage  data.  At  the  present  time  this 
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is  restricted  to  the  collection  of  usage  data  from  the  Polaris  Weapon 
System.  Based  on  the  usage  data  received  thus  far,  which  does  not 
extend  over  a  very  long  period  of  time,  one  agedji  observes  a  very  low 
euid  sporadic  demand  situation,  mie  total  number  of  demeuids  per  Polaris 
patrol  are  extremely  small  and  the  coitmonal  Ity  of  line-items  vised 
between  patrols  is  very  low.  Also,  the  commonality  of  items  demanded 
between  different  Polaris  submarines  Is  again  very  small.  However, 
based  on  the  relatively  small  amount  of  dememd  data  received  thus  far 
there  Is  one  additional  important  observation.  The  usage  data  being 
collected  Includes  "application  data,"  l.e..  Identification  of  the  cran- 
ponent  In  which  the  part  Is  replaced.  Based  on  only  a  small  amount  of 
evidence,  one  does  observe  here  that  Independent  of  particular  or  unique 
stock  numbers,  there  Is  a  fair  amount  of  commonality  In  regard  to  the 
components  for  which  Items  are  used.  lIMs  Is  Interesting  In  that  It 
begins  to  confirm  a  hypothesis  which  we  have  been  seeking  to  test  for 
some  time.  ISiat  Is,  while  demand  for  llne-ltons  Is  very  low  and  very 
spozmdlc,  the  bulk  of  the  Items  which  are  used  pertain  to  a  very  small 
per  cent  of  the  total  nusibcr  of  components  Installed.  If  this  is  true 
then  some  headway  can  be  made  In  determining  operational  variables  by 
relating  to  the  function  of  those  components  which  are  "Item  users ." 
Also,  if  this  Is  true  this  sviggests,  together  with  what  has  been 
learned  In  the  area  of  military  essentiality  of  repair  parts,  that 
Items  should  be  classified  In  terms  of  particular  characteristics  of 
the  components  In  which  they  are  Installed.  That  Is,  possibly  we  should 
not  look  at  masses  of  Individual  line  items  or  even  attempt  to  group 
these  line  Items  by  dollar  value,  by  commonality  of  nomenclature,  etc., 
but  rather  as  particular  functions  relating  to  contponent  applications. 
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Recently  a  study  has  been  congpleted  concerning  the  demand  for 

(20) 

spare  parts  for  naval  aircraft. 

At  the  present  time  the  USN  Aviation  Supply  Office  (ASO)  uses  two 
procedures  for  the  determination  of  requirements  for  system  stocking. 
Items  under  the  Inventory  management  of  ASO  are  split  into  two  large 
groups  depending  on  which  of  the  two  procedures  are  to  be  applied  to 
the  Item.  One  procedure ;  termed  "Replenishment  Demand  Issue  System" 
(RDIS)  Is  to  compute  future  requirements  solely  on  the  basis  of  past 
demands.  Fbr  the  second  procedure^  termed  "Program  Usage  Replenishment 
Rystem"  (PURS)  usage  Is  considered  to  be  a  function  of  flying  hours 
and  future  recpilrements  are  conquted  on  the  basis  of  cm  estimate  of 
future  flying  hours . 

In  FURS  It  Is  assumed  that  usage  varies  In  a  linear  and  proportional 
manner  with  flying  hours .  Ihe  prlnclped  objective  of  the  recent  study 
was  to  examine  the  validity  of  this  assuoiptlon .  The  data  engployed  repre¬ 
sented  usage  for  approximately  two  hundred  aircraft  of  a  piurtieular  plane 
type  operating  over  a  three -and-a-half -year  period. 

The  results  of  this  study  may  be  summarized  as  follows: 

(1)  Usage  patterns  do  not  conform  to  the  FURS  assumption 
concerning  the  relationship  of  \isage  to  flying  hours . 

(2)  Of  a  total  number  of  177^  medntenance  usage  parts 
obsez’ved^  only  about  60  Items  were  correlated  with 
flying  hours.  This  resulted  In  some  Interest  In 
exploring  the  relationship  of  usage  to  other  possible 
program  elements,  such  as  numbers  of  aircraft,  numbers 
of  fll^its,  nuBibers  of  landings,  etc.  Here  again  the 
results  do  not  support  the  assunptlon  of  proportional 
llnaarlV  between  usage  and  cmy  of  these  program  ele¬ 
ments.  It  Is  also  significant  to  note  that  of  cGJ.  the 
program  elements  studied,  flying  hours  ranked  as  the 
least  efficient  estimator  of  aircraft  parts  deaamd. 

While  no  single  program  alenant  showed  a  sl0ilfleaat 
correlation  with  Item  usage,  projections  hewed  on 
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number  of  "operating  aircraft"  provided  better 
resvilts  than  any  other  program  element. 

(3)  Demand  for  aircraft  repair  parts  is  extremely  low 
and  sporadic.  In  fact,  the  demand  patterns  are  about 
the  same  as  those  observed  for  ship's  repair  parts. 

This  demand  behavior  alone  indicates  that  visage  would 
be  Insensitive  to  variations  in  flying  hours.  An 
additional  similarity  is  an  indication  that  usage 
may  be  closely  identified  with  the  population  (i.e., 
number  of  installations)  of  the  part. 

(4)  One  final  point  of  Interest  concerns  the  estimates 
of  the  activity  level  as  represented  by  the  program 
element  of  flying  hours.  It  was  found  that  on  the 
average,  the  projections  of  flying  hours  for  the 
future  period  were  overestimated  by  approximately 
40  per  cent.  Hence,  even  if  ussige  were  related  to 
flying  hours,  the  predicted  demands  would  be  in  error 
by  this  amount. 

A  first  Important  conclusion  from  this  work  is  that  most  commonly 
proposed  techniques  for  demand  predictions  have  not  produced  resvilts 
which  vould  be  acceptable  for  use  in  any  stral^tforward  manner  in 
Inventory  problems .  Hie  principal  vinderlying  reason  for  this  appears 
to  be  that,  with  few  exceptions,  the  demand  for  repair  parts  in  mili¬ 
tary  systems  is  extremely  low  and  sporadic,  nils  hl£^  degree  of  vmcer- 
talnty  of  demand  for  line-items  must  be  recognized  in  the  development 
of  future  Inventory  models. 

Given  the  observed  behavior  of  demaxid  and  the  difficulty  of  demand 
prediction,  it  is  necessary  to  formulate  models  for  Inventory  systems 
irtiich  attempt  to  e]q)licitly  account  for  this  behavior.  That  is,  to 
some  significant  degree,  earlier  inventory  models  which  typically  are 
hlc^y  sensitive  to  the  demand  prediction  problem,  should  be  re¬ 
formulated  to  minimize  and/or  control  this  condition.  An  exaaqple  of 
t-Ma  is  the  development  of  inventory  models  where  the  "military  value" 
of  repair  parte  la  highly  ai^ilflcant  for  the  datamlnatlon  of  atodt 
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Althoui^  the  problem  of  demand  prediction  may  be  reduced  by 
employing  other  variables  in  inventory  models,  this  does  not  mean 
that  it  cam  be  completely  ignored.  While  many  past  investigations 
did  not  provide  suitable  results,  there  are  some  indications  of 
promising  results  in  the  future,  nils  includes  the  relationship  of 
demands  to  operational  variables  not  previously  utilized;  the  dependence 
of  demeinds  on  population  of  installed  parts;  the  clcussification  of 
parts  in  terms  of  their  component  applications;  etc.  Also,  there  is 
much  to  be  done  in  investigating  the  effects  of  different  demand 
distributions  on  the  costs  axid  benefits  in  terms  of  i>articular  inventory 
problems . 
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SUMMARY  PRESENTATION  ON  DEMND  FORECASTING 

Robert  G.  Brown 
Arthur  D.  Little,  Inc.* 

As  a  matter  of  terminologj  we  distinguish  between  two  approaches 
to  estimating  future  requirements.  The  word  prediction  is  used  to 
refer  to  subjective  estimates.  Forecast  refers  to  objective  computa¬ 
tions  on  historical  data  which  may  include  past  demand  or  past  predic¬ 
tions  about  demand.  In  this  sense,  our  work  has  concentrated  on 
forecasting  rather  than  prediction. 

In  designing  a  forecast  system  we  identify  six  major  steps  where 
systems  design  decisions  must  be  made:  (1)  data;  (2)  model;  (3) 
smoothing  techniques;  (4)  forecast;  (5)  error  measurement,  and  (6) 
safety  factor. 

Data.  The  data  from  which  forecasts  are  made  are  most  generally 
periodic  summaries  of  past  demand.  The  summaries  may  be  made  monthly 
or  quarterly.  The  most  serious  problem  we  have  encountered  in  our 
work  for  the  Navy  is  that  consianption  in  the  Fleet  is  very  much 
obscured  by  independent  inventory  management  decisions  at  several 
echelons  between  the  consumer  and  the  ICP  forecasting  future  demand. 

In  some  cases  it  has  proved  useful  to  consider  inter-arrival 
times  rather  than  demand  rates  as  the  data.  We  have  also  considered 
optional  installation  rates  of  attachments  on  prime  equipnent. 

This  paper  presents  a  brief  summary  of  the  work  we  have  done  for 
the  Bureau  of  Supplies  and  Accounts,  Navy  Department,  under  Contract 
No.  Nonr-3406(00). 
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Model*  There  are  three  basic  types  of  models  that  we  have  con¬ 
sidered  in  describing  past  demand.  One  is  the  time  series  in  which 
local  segments  of  the  pattern  can  be  described  by  polynomials,  trans¬ 
cendental  functions  or  even  empirical  functions  of  time.  The  second 
is  the  renewal  equation  in  which  knowledge  of  the  number  of  pieces  of 
equipment  installed  and  the  distributions  of  time  to  failure  can  be 
used  to  evaluate  the  distribution  of  future  demand.  The  third  model 
is  an  empirical  probability  distribution  for  the  level  of  demand  in 
any  period. 

Smoothing  Techniques.  We  have  been  primarily  concerned  with 
methods  suitable  for  high-sp)eed  internally  programmed  digital  computers 
pi*ocessing  a  very  large  number  of  items  each  period.  The  criterion 
for  accuracy  in  a  smoothing  technique  is  a  discounted  least-squares 
estimate  of  the  parameters  in  the  model.  Since  a  great  many  items 
must  be  processed,  the  calculations  have  been  reduced  to  simple  linear 
arithmetic  with  files  containing  only  one  word  of  historical  information 
p>er  degiree  of  freedom  in  the  model. 

No  economic  time  series  can  be  represented  over  a  long  period  of 
time  by  a  single  model.  Therefore,  we  have  discounted  past  information. 
The  discount  factor  can  be  changed  at  any  time  to  alter  the  balance 
between  stability  in  the  fact  of  random  fluctuations  and  rapid  response 
to  transient  changes  of  pattern. 

The  concept  of  exponential  smoothing'*!'  has  been  extended  to  the 
adaptive  fitting  of  the  coefficients  In  tmnscendental  as  veil  as  poly- 

~  * 

Robert  G.  Brcem,  Statistical  Forecasting  for  Inventory  Control. 
McGraw-Hill,  1959. 
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nomlal  models  so  that  seasonal  and  cyclic  effects  can  be  adequately 
represented  at  very  little  effort. 

Forecast «  Generally  a  forecast  is  obtained  as  an  evaluation 
of  the  model  at  future  time.  We  have  developed  two  modifications. 

The  coefficient  of  higher  order  terms  can  be  tested  for  statistical 
significance.  If  there  are  no  significant  differences  from  zero, 
they  can  be  set  equal  to  zero  to  minimize  the  various  amplifications 
in  the  forecast.  The  second  notion  is  a  progressive  discounting  of 
higher  order  coefficients  in  future  time. 

Error  Measurement.  Any  forecast  or  prediction  must  be  compared 
with  the  actual  data  later  when  it  is  available.  These  errors  have  a 
distribution.  The  tracking  signal  is  useful  in  deciding  whether  the 
mean  of  the  distribution  is  approximately  zero.  The  mean  absolute 
deviation  is  simpler  to  compute  than  the  standard  device.  We  have 
developed  some  of  the  statistical  propeirties  of  the  mean  absolute 
deviation.  We  have  further  shown  that  for  a  very  wide  class  of  dis¬ 
tributions  for  the  input  data,  decisions  based  on  an  assumption  of 
normally  distributed  errors  are  satisfactory. 

Safety  Factor.  The  order  point  in  an  inventory  control  system 
can  be  expressed  as  the  forecast  *  k(MAD)  where  k  Is  a  safety  ftictor 
gwierally  between  0  and  3*  The  value  of  the  safety  factor  is  selected 
on  the  basis  of  current  policy  regarding  routine  service.  We  have 
developed  formulas  and  curves  for  the  safety  factor  under  three 
philosophies:  (1)  for  a  specified  chance  of  rxuining  out  at  the  end 
of  a  replenishment  cycle;  (2)  for  a  specified  chance  of  running  out  as 
influenced  by  the  frequency  with  which  the  item  is  replenished; 
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(3)  for  minimum  total  cost  under  a  variety  of  assumptions  about 
linear  and  quadratic  cost  of  shortage  and  over-supply. 

All  of  this  material  and  more  is  to  be  published  in  book  form, 
'•Smoothing,  Forecasting,  and  Prediction  of  Discrete  Time  Series". 

A  complete  draft  of  the  manuscript  will  be  available  about  1  April 
1962.  Copies  of  the  manuscript  can  be  made  available  on  loan  to  anyone 
who  will  agree  to  provide  critical  comments  on  this  draft. 
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DEMAMD  PREDICTION  AND  INVENTORY  CONTROL* 

John  F.  Muth 

Carnegie  Institute  of  Technology^ 

It  has  been  assumed  —  perhaps  too  often  —  that  inventory  con¬ 
trol  difficulties  would  magically  disappear  if  better  forecasts  could 
only  be  found.  I  would  like  to  suggest  that  the  relation  between 
forecasting  and  the  uses  to  which  forecasts  are  put  is  not  quite  so 
simple.  It  is  important  to  analyze  the  decision-making  process  in 
inventory  control,  in  order  (l)  to  know  what  to  forecast  and  (2)  to 
understand  the  effects  of  forecast  errors.  Althou^  this  point  is 
hardly  a  new  one,  I  have  generally  fo\md  it  overlooked  in  ind-ustrial 
operations  research  studies. 

The  interaction  between  forecasts  and  inventory  control  systems 
can  best  be  clarified  by  means  of  illustrations.  I  will  describe  two 
cases  in  point.  The  first  is  a  manufacturer  of  specialty  steels;  the 
second,  a  battery  manufacturer. 

A  STEEL  MANUFACTURER 

Steel  firms,  like  many  others,  are  faced  with  warehousing 
decisions  concerning  inventories  in  regional  warehouses.  One  company 
maintains  stocks  of  some  4000  items  in  about  35  warehouses  throu^out 

♦This  paper  is  based  on  a  talk  given  by  the  author  at  the 
Conference . 

♦♦School  of.  Industrial  Administration. 
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the  country,  in  addition  to  stocks  in  several  plant  locations.  Demands 
for  many  of  these  items  are  extremely  difficult  to  predict.  For  some 
individual  products  no  demands  mi^t  be  experienced  at  all  for  several 
months.  Then  a  very  large  order  may  come  in.  In  fact  the  distribution 
of  demands  is  so  extreme  that  Tchebysheff  *s  inequality,  taken  as  an 
equality,  appears  to  be  a  good  approximation  to  the  probability  distri¬ 
bution  of  sales,  at  least  in  the  range  relevant  for  inventory  control. 

The  problem  of  inventory  control  at  this  firm  is  made  somevhat 
more  difficiilt  by  the  company  policy  that  no  demand  for  the  product 
is  to  be  left  unsatisfied  at  a  warehouse  if  the  item  can  be  shipped 
from  some  other  warehouse  or  from  a  plant.  From  the  standpoint  of 
operations  analysis,  however,  this  restriction  suggests  at  least  one 
way  in  which  the  analysis  might  be  simplified.  It  also  allows  us  to 
replace  the  ambiguous  notion  of  ’’depletion  penalty”  by  the  much  better 
\anderstood  cost  of  shipping  from  one  warehouse  to  another,  the  ’’trans¬ 
shipment  cost. ” 

The  economics  of  truckloaxi  rates  do  not  apply  to  any  particxalar 
item  stocked  by  the  warehouse,  but  instead  to  all  items.  It  is 
therefore  economical  to  have  regular  replenishment  shipments  from  the 
plant  to  each  of  the  warehouses.  The  frequency  of  shipment  would 
depend  on  the  total  sales  of  the  warehoxise.  The  only  problem  is 
determining  the  amount  of  each  item  to  be  incluied  in  the  regular 
replenishment  shipment. 

A  reasonable  way  of  approaching  the  problem  is  to  assign  for 
each  item  in  each  weirehouse,  a  ’’ceiling  inventory”  denoted  by  M.  The 
amount  ordered  would  be  such  that  the  inventory  after  receipt  of  the 
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order  wo\ald  be  M  units  of  the  item.  We  identify  tvo  types  of  costs: 

(l)  inventory  storage  charges  and  (2)  the  extra  costs  of  trans-shipping 
an  item  from  another  warehoiose  when  it  is  out  of  stock. 

If  R  is  the  storage  cost  per  pound  within  the  replenishment 
cycle  and  fX  is  the  average  demand  rate  during  the  period,  then  the 
storage  cost  would  on  the  average  be 


(1)  R(M->u/2) 

Suppose  the  demands  for  the  period  D  have  a  density  function  f(D) 
and  that  the  trans-shipment  premium  is  P.  Then  the  average  trans¬ 
shipment  cheirge  to  be  incurred  with  the  item  is  represented  by 

•*00 


(2) 


r 

•'m 


(D  -  M)  f(D)  dD. 


Taking  the  sum  of  the  two  costs  above  and  setting  the  derivative 
with  respect  to  M  eqiaal  to  zero,  we  obtain  the  following  conditions 
for  a  minimum  cost: 


(3)  1  -  F(m)  =  R/P  if  0  <  r/p  <  1 

M  =  0  if  1  <  R/P 

F(M)  is  the  cumulative  distribution  function  at  M,  so  that  1  -  F(m) 
in  EcLuation  (3)  is  the  probability  of  a  runout. 

The  other  ingredients  of  the  inventory  computations  are  three 
forec8U3ts:  (l)  the  expected  demand  during  the  reorder  cycle,  (2) 
the  standard  deviation  of  the  forecast  error,  and  (3)  expected  cost 
of  trans-shipment.  The  first  two  of  these  appear  as  parameters  of 
the  distribution  function  F(d).  The  last  is  necessary  because  the 
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cost  of  shipping  varies  from  one  cycle  to  the  next  depending  on 
demands  for  the  item  at  the  other  warehouses* 

The  resulting  inventory  control  system  is  quite  simple*  Many 
"unwEirranted"  assumptions  have  heen  made  in  the  course  of  the  analysis. 
Nevertheless,  simulation  tests  indicate  that  such  a  system  would 
result  in  siibstantial  cost  savings.  It  would,  in  addition,  allow 
better  managerial  control  of  the  inventory  positions  at  the  various 
wareho\ises.  By  raising  the  parameter  R,  the  cost  of  storage  during 
the  reorder  cycle,  management  could  lower  rather  effectively  the 
inventory  either  in  the  entire  system,  or,  more  selectively,  by 
warehouses  or  product  groups. 

A  BATTERY  MANUFACTURER 

This  firm  has  a  forecasting  problem  which  resembles  that  of 
military  parts  management  in  several  ways.  The  firm  is  a  manufacturer 
of  a  wide  line  of  storage  batteries  for  automobiles,  trucks,  boats, 
etc.  An  un\asual  feature  of  the  forecasting  problem  is  that  demands 
of  the  firm  appear  to  be  sensitive  to  weather  conditions.  It  appears 
that  some  ^marginal”  batteries  in  use  may  deteriorate  if  there  is  a 
sudden  drop  in  temperature  or  sustained  low  temperatiores .  The  months 
of  December  and  January  present  special  problems  in  forecasting  demands. 
The  problem  is  particialarly  severe  because  these  months  come  immediately 
after  the  usual  seasonal  peak  in  sales.  The  inventory  system  may  not 
be  in  a  position  to  have  sufficient  inventories  to  avoid  the  risk  of 
a  lot  of  '*panic"  production  if  the  so-called  ’Veather  surge”  develops. 

Two  basic  approaches  to  forecasting  seem  to  be  relevant.  The 
first  is  relatively  elaborate  and  would  probably  not  be  justified 
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unless  byproducts  could  be  obtained  --  for  example,  product  design 
or  long-run  forecasts  of  sales.  Quite  a  bit  of  information  is 
req^uired  in  order  to  relate  battery  sales  to  weather  characteristics. 
It  is  necessary  to:  (l)  make  estimates  based  on  experimental 
evidence  of  the  probability  of  battery  failure  as.  a  function  of  its 
age  and  the  weather;  (2)  find  some  means  cf  determining,  perhaps  by 
survey  sampling  techniques,  what  the  existing  age  distribution  of 
batteries  is;  (3)  take  account  of  the  age  distribution  of  the  stock 
of  batteries  in  use,  in  order  to  predict  failures  of  batteries  for 
given  weather  conditions,  using  the  difference  equations  of  renewal 
theory;  (k)  try  to  find  a  good  forecast  of  the  weather,  from  which 
replacement  demand  could  then  be  estimated.  Enormoiis  strides  have 
been  made  since  the  day  (1922)  that  L.  F.  Richardson  proposed  to 
conduct  an  orchestra  of  64,000  trained  coraputors,  just  to  keep  ahead 
of  weather  data  from  all  over  the  world.  It  is  still  almost  impos¬ 
sible  to  predict  with  any  perceptible  accuracy  the  particiolar  weather 
characteristics  required  for  forecasting  battery  demands  (for  example, 
the  severity  of  the  temperature  drops  through  a  cold  front,  the 
size  of  the  "puddles"  of  polar  air,  etc.).  The  main  conclusion  about 
this  approach  seems  to  be  that  it  may  be  usef\il  in  understanding  the 
nature  of  replacement  demands  (we  even  have  the  best  possible 
exogenoias  variable  for  an  economic  equation  system  —  the  weather)  but 
it  has  little  merit  as  a  forecasting  device  for  inventory  control. 

The  main  reason  is  that  the  data  requirements  are  much  too  large 


and  too  remote. 
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There  is  an  alternative  procedure  that  is  considerably  simpler. 

It  assumes  that  the  most  benefit  can  be  obtained  by  keeping  the  fore¬ 
casting  procediure  relatively  simple,  but  taking  into  account  the 
fact  that  the  forecasts  vill  not  be  as  accurate  during  the  months 
when  weather  surges  are  possible.  We  can  realize  this  by  inclviding 
seasonal  adj\istments  in  the  standard  deviation  of  forecast  errors 
used  in  the  calculation  of  reorder  points,  lot  sizes,  and  so  forth. 

This  approach  requires  little  modification  of  the  inventory  calculations, 
except  that  a  parameter  changes  from  one  month  to  the  next. 

Seasonal  factors  in  the  estimate  of  the  standard  deviation 
may  be  found  by  adapting  the  exponential  forecasting  schemes,  which 
have  already  been  discussed  in  this  Conference  by  Robert  G.  Brown 
and  Peter  R.  Winters.  Let  represent  the  demands  for  an  item  in  a 
period  of  time  t  and  represent  the  forecast  of  the  demand  for 

the  item  during  that  time  forecasted  at  time  t-L.  We  start  with  some 
measure  of  the  forecast  error: 


{h) 


t-L,L 


P 


With  p  =  1,  we  are  measuring  the  absolute  deviations;  with  p  =  2,  we 
are  using  the  squared  deviations,  as  is  frequently  done  in  statistics. 
Whatever  way  we  may  define  it,  the  variable  is  the  one  to  be 
estimated  and  revised  each  month.  It  will  then  be  i>ossible  to  derive 
the  standard  deviation  from  a  forecast  of  E, 

We  assvmie  for  piorposes  of  illustration  that  there  are  twelve 
seasonal  factors  associated  with  the  months  of  the  year.  Let  these 
be  denoted  by  F^,  •••  ,  F^^g.  Then  the  seasonally  adjusted  error 
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for  the  last  month  would,  from  Equation  (14-),  be  where  j  is 

O  J 

the  appropriate  index  for  the  month.  The  predicted  value  of  the 
seasonally  adjusted  error,  denoted  by  E^,  would  then  be  given  by 
an  exponential  smoothing  formiila: 


(5) 


E 


■t  -  *  ■>  (1  - ^.1 


where  0  <  A  <  1.  Values  of  A  close  to  unity  correspond  to  substantial 
revisions  of  the  seasonally  adjusted  error  by  means  of  the  recent 
experience. 

The  seasonal  factors  themselves  would  then  be  revised.  Let  the 

new  seasonal  factor  for  the  month  be  denoted  by  F*.  Then  since  the 

J 

ratio  represents  the  last  seasonal  factor  observed,  exponential 

smoothing  of  the  seasonal  factors  would  be  given  by  an  expiession  of 
the  form 


(6)  Fj  =  B(E^/i^)  +  (1  -  B)  Fj 

where  0  <  B  <  1. 

A  predictioi  of  the  error  T  months  from  now,  denoted  by  5.  _, 

t,T 

would  be  the  product  of  the  last  seasonally  adjusted  error  and  the 
seasonal  factor  referring  to  the  desired  month.  Ohat  is 

\t  =  \  V 

where  k  is  the  appropriate  monthly  index. 

The  estimate  of  the  standard  deviation  may  be  found  from  the 
forecast  rp*  The  nature  of  the  conversion  depends  on  the  probability 
distribution  of  the  forecast  errors.  In  the  special  case  of  the  normal 
distribution,  the  relation  is  given  by 
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(8) 


"2^  ^  if  p  =  1  (in  Equation  (k)) 


An  inventory  control  system  utilizing  seasonal  factors  in  the 
error  estimates  in  the  determination  of  protective  stocks  is  now  in 
the  process  of  being  installed.  Although  the  system  is  not  fully 
developed  yet,  the  prospects  for  better  control  and  for  cost  savings 
appear  good.  An  important  thing  to  keep  in  mind  --  and  this  has 
sometimes  been  overlooked  during  the  discussions  —  is  that  a  great 
deal  of  accuracy  in  demand  forecasts  is  not  always  essential  for 
inventory  control.  Sometimes  specistl  forecasting  problems,  such  as 
the  weather  surge,  may  be  accommodated  in  other  ways. 


CONCLUSIONS 

I  hope  the  cases  cited  show  how  close  the  interaction  is  between 
demand  prediction  and  development  of  inventory  control  systems. 

First,  the  cost  analysis  indicates  the  properties  of  the  system  that 
would  in  fact  have  to  be  predicted.  In  both  cases  it  was  necessary 
to  predict  the  range  of  forecast  error  as  well  as  the  forecast  itself. 
Costs  of  trans-shipment  also  had  to  be  predicted  for  the  steel  manu¬ 
facturer.  Second,  the  theoretical  analysis  is  also  needed  to  show 
what  kinds  of  forecast  errors  can  be  tolerated  by  a  proposed  inven¬ 
tory  control  system.  It  is  meaningless  in  itself  to  know  that  fore¬ 
cast  accuracy  is  within  +  10^.  The  relevant  information  is  the 
qxxality  of  the  decisions  based  on  the  forecasting  schemes. 
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TND  BQPOHBITIALLY  WEIC^TED  FQRECASTINO  N0ISU3: 

THEORY  ADD  PRACTICE* 

Peter  R.  Winters 

Carnegie  Institute  of  Teetmology 

Ky  paper  concerns  two  distinct  things.  First  I  relate  sons  of 
the  experience  ve  have  had  with  the  exponentleiUy  weighted  moving 
average  forecasting  scheme  that  was  reported  on  In  Management  Science 
In  April,  1960.^^^  The  second  thing  relates  to  a  series  of  models 
developed  hy  R.  J.  Ouffln  of  Ceunegle  Tech  in  work  he  has  done  for 
the  Office  of  Ordnance,  United  States  The  second  r^ort 

will  he  published  shortly  and  Is,  as  of  this  time,  available  only  in 
reproduced  form  from  the  Mathematics  Department  of  Carnegie  Tech.""" 

A  SET  OF  KgQHBBTIALLY  WEIGHTED  MOVIMG  AVERAGE  MODELS 

Let  me  begin  by  reviewing  several  models  that  were  reported  on  la 
Ref.  1.  The  slimiest  model  assumes  no  trend  and  no  seasonal. 

(1)  9;  .  AS^  .  (1  -  A)  s;.^  , 


Research  was  undertaken  for  the  project,  PlManln|M||ad_Coatool^^ 
Industrial  Operations,  under  contract  with  the  oA.ee  Ihvai  RMeareh. 
Contract  N-otu‘-76O-(01) .  Project  HR  047011. 

## 

School  of  Industrial  Admlnletxmtion 
***See  Appendix,  p.  B2. 
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3.  is  the  BeJjes  In  the  t—  period.  S.  is  the  smoothed  estimate  of  the 

t  V 

mean  of  the  sales  distribution  during  the  t^  period: is  estimated 

at  the  end  of  the  t^  period  when  the  information  of  actual  seiles  has 

become  available;  is  defined  in  the  same  way  eus  S^.  Finally,  the 

forecast,  S.  _,  is  made  at  the  end  of  period  t  for  T  periods  into 

t,T 

the  future.  cam  be  shown  to  be  an  unbiased,  but  not  efficient, 
estimate  of  the  mean  of  the  distribution  of  sales  if,  in  fact,  this 
distribution  is  unchanging  over  time.  If  this  assumption  is  met,  of 
course,  a  simple  average  would  be  a  better  estimate.  This  simple 
model  is  reconmended  for  use  when  there  are  some  systematic  movements 
of  the  mean  of  the  distribution  but  yet  movements  which  one  does  not 
wish  to  capture  explicitly  in  a  model.  The  Justification  for  using 
this  model  is  that  it  seems  to  work  all  right.  This  first  model  is 

/I4.) 

exactly  eguiveQ.ent  to  Brown's  model'  '  \dilch  he  calls  "single  smoothing" 
and  to  Duffin' 8  model'  '  where  the  order  of  the  polynomial  is  zero. 

The  second  model  is  one  which  has  a  linear  trend,  but  no  seasonal 
effect.  It  consists  of  two  equations  plus  the  forecast. 


(2) 


Sj  -  A3^  +  (1  -  A) 

Rt  -  0(3;  -  s;.^)  .  (1  -  0) 


In  this  model  is  an  estimate  of  the  units  per  period  that  the  mean 
is  increasing  or  decreauslng,  made  at  the  end  of  the  t —  period.  [All 
of  the  other  quantities  have  been  defined  above^  This  two-equation 
model  seems  to  be  equivalent  to  the  model  that  Brown  calls  "double 
smoothing,"  and  in  it  one  is  reqdired  to  save  two  pieces  of  information, 
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the  T  and  the  R,  oaleulated  lest  period.  Notice  that  In  ell  of  the 
■odela  the  eonstruetloD  follows  the  saiae  pettem.  For  eeoh  component 
of  the  model  there  are  two  eatlmetes:  one  nede  prevloualy  and  e 
current  one.  These  two  are  weighted  together  to  obteln  e  now  ourrent 
estimate. 

The  third  model  in  this  set  is  one  whlA  eontelns  e  linear  trend 
and  ratio  seesonels. 

^  *  "‘-i’  ’ 

\  -  o(r^  -  j .  (1  -  0)  , 

®t,T  ■  ^t-lM  ■ 

N  >  No.  of  periods  per  cyole; 

0  ^  C  ^  1  . 

This  model  is  essentially  the  same  as  the  one  above  except  that  current 
sales  are  deseasonalized  by  the  seMonal  factors  F;  and  then  these  F's 
aze  used  in  forecasts.  Notice  here  that  the  amount  of  Informa¬ 

tion  %fhleh  must  be  saved  from  period  to  period,  for  each  forecasted 
series,  goes  vqp  substantially.  We  must  save  T  and  R  as  before,  and 
now,  in  addition,  twelve  seasonal  fhetors  if,  in  fact,  our  cycle  con¬ 
sists  of  twelve  periods.  The  seasonal  factors  were  included  because 
a  nuniber  of  interesting  time  series  appear  to  have  seas<nials  in  them. 
They  seem  to  add  substantially  to  the  ability  to  foreoast,  particularly 
whan  one  is  foreeasting  soam  distance  into  the  future. 


I 
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OBIERAL  EXPONENTIAL  FORECASTING  PROGRAM  (GEFP) 

TMs  program^  is  written  in  POR'niAN  for  the  IBM  65OJ  other 
FORTRAN  versions  exist  for  700  series  machines.  It  is  an  extension 
of  the  coniputer  program  illvistrated  in  the  Management  Science  article; 
it  allows  more  flexibility  and  gives  more  information.  The  GEFP  Program 
tries  out  the  forecasting  model  on  a  time  series,  evaluating  the  accu¬ 
racy  of  prediction  by  several  different  measures,  and  permits  testing 
of  the  exponential  weights. 

Figure  1  Illustrates  this  effect. 


1  2 
Fig.  1 


The  time  series  analyzed  is  cusstaaed  to  be  made  up  of  D  observa¬ 
tions  of  setles  (for  "sales"  the  user  can  substitute  the  name  of  what¬ 
ever  series  he  is  analyzing)  in  units  per  period,  S^,  for  t  ■  1,  ..., 
D.  The  nuniber  of  periods  per  cycle  is  N.  For  exaoqple,  N  would  be 
12  for  the  number  of  months  per  year.  The  program  uses  the  early 
part  of  the  data  (t«l,  ...,  H)  in  a  coomon  sense  way  to  determine 
values  of  7,  R,  and  the  seasonal  llaetora  which  are  saved  in 
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permanent  locations.  Tbe  eipponentlal  model  \ises  these  values  and  a 
set  of  weights  (A,  B,  C)  read  in  at  to  stcurt  at  then  simulates 
the  use  of  the  exponential  model  through  without  forecasting.  At 
Qg  the  model  begins  to  meike  forecasts,  continuing  to  do  so  xintll  it 
reaches  the  end  of  the  data.  At  each  period  forecasts  for  F  periods 
into  the  future  axe  made.  These  forecasts  are  compeured  with  actual 
sales,  the  foreceust  errors  cure  computed,  and  the  stna  of  squared 
errors  is  collected  for  each  forecasting  period.  For  example,  e^J. 
the  one -period-ahead  forecast  errors  are  collected,  then  the  two- 
perlod-aheeid  forecast  errors  are  collected,  etc.  These  sums  of  squared 
errors  are  used  in  two  pletces:  (l)  in  the  ctQ.culatlon  of  one  of 
the  meeuiures  of  accviracy  of  prediction,  and  (2)  in  the  calculation  of 
standard  deviations  of  forecast  errors  and  coefficients  of  variation. 

The  first  criterion  of  prediction  aoeuxmey  is  a  weitfited  sum 
of  squared  foreceust  errors 

f  -  £  (E  ^)y.  E  -  (t  -  s) 

kpl  t 

The  w's  are  welj^ts  that  indicate  the  relative  iiqportanee  of  forecasts 
for  each  period  in  the  future.  If  the  program  user  is  interested 
in  simply  a  one-perlod-aheaid  forecast,  then  P  >  1,  w^  »  1.  If  he  wants 
to  forecasts  for  three  periods  each  time  he  forecasts,  then  P  «  3; 
a  possible  set  of  wei^ts  would  be  w^  ■  .5,  Wg  ®  .3,  w^  ■  .1  (the 
weights  need  not  add  up  to  l) .  If  he  wants  to  forecast  only  the  14^ 
period  into  the  future,  then  P  =  4  and  *  ^2  “  ^^3  “ 

(icbtially,  all  four  forecasts  will  be  made,  but  the  first  three  will 
be  iipoored  in  ooavuting  ^.) 
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The  second  eriterlMi  Is  avexmge  frsotionsl  error.  Althou^^  the 
fonwlA  Is  coiqpllcated,  the  Idea  Is  siBQ>le.  This  iseasure  calculates 
the  average  absolute  error  for  all  forecasts  made  and  divides  it  by 
the  average  sales  over  the  forecast  period.  This  allows  the  user  to 
ake  stateasnts  as  "The  average  error  was  lyft  (or  2Jl>)  of  sales." 


Ibe  third  criterion  uses  standard  deviations  of  forecast  errors  and 
coefficients  of  variation.  The  GE3T*  also  calculates  the  standard 
deviation  and  the  coefficient  of  variation  for  each  k,  that 
Is,  for  the  ane^perlod-ahaad  forecasts,  the  two-parlod-ahead  fore¬ 
casts,  and  ao  on. 


(E  E^). 

t  _ 

D  -  P  -  Qg  +  1 

t=Vl 

A  nunber  of  options  are  available  to  the  user.  For  anavle,  the  pro- 
gran  nay  be  used  either  with  or  without  trend,  or  with  or  without 
seasonal  fisotors.  Vhrlable  output  Inframtlon  is  also  avmlUble. 
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lasimrs  amp  motes  to  users 

Evaluation  of  the  forecasting  ability  of  the  third  isodel,  the  one 
with  linear  trend  and  ratio  seasonals,  depends  upon  several  factors: 

(1)  the  criterion  function;  (2)  the  vay  In  which  the  data  Is  used  to 
generate  starting  values;  and  (3)  the  (ABC)  weights  that  are  used. 

One  reasonable  absolute  sMsure  Is  the  coefficient  of  variation  (fore¬ 
cast  error  standard  deviation  divided  by  average  sales) .  For  a  fore- 
cast  of  one -period-ahead  and  for  the  best  set  of  weights  for  a  par¬ 
ticular  piece  of  data  based  upon  o\ir  rather  limited  experience  with 
the  model,  the  coefficient  of  variation  varies  scoewhere  between  .10 
and  .33.  I  would  consider  .10  rather  successful.  In  general  I  would 
say  that  my  aspirations  now  are  much  lower  than  they  were  when  I  began 
casting  about  for  a  forecasting  method.  It  seems  unlikely,  If  relative 
costs  of  computing  and  storage  are  about  the  same,  that  substantially 
better  methods  will  be  foxuid. 

Finding  the  A,  B,  C  weights  which  minimize  the  criterion  fxmctlon, 
say  (^  ,  Is  a  matter  of  trial  and  error.  Several  different  schemes 
have  been  tried  out  on  this  problem.  These  Include  enumeration  of 
the  points  of  a  three-dimensional  grid.  In  the  case  of  the  third  model; 
second  a  gradlemt  method;  and  third,  another  method  of  direct  search. 


This  forecasting  method  has  been  used  extensively  with  an  Inven¬ 
tory  control  model^^^^’^^  In  which  the  ability  to  forecast  Is  measured 
by  the  variance  of  forecast  errors,  relative  to  average  sales.  The 
lower  this  variance,  the  lower  the  cost  of  the  Inventory  system  will 
be.  For  Inventory  models  based  on  other  characteristics  of  assumed 
sales  distributions,  other  criteria  may  be  more  relevant. 

Best  A,  B,  C  weights  for  i  for  one-period-ahead  and  three- 
perlods ■ahead  foreoaets  are  about  the  same. 
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One  adventege  of  the  grid  method  Is  that  It  gives  some  notion  about 
the  entire  surface  of  the  criterion  function.  This  surface  turns 
out  to  be  non-convex  over  its  entire  range.  However,  in  the  neighbor¬ 
hood  of  the  optimum,  the  surface-  is  convex.  The  direct  search  technique 
which  we  hooked  vq)  with  the  forecasting  program  was  the  one  reported 

/Q) 

by  Hooke  emd  Jeeves  in  the  Journal  of  the  ACM  last  year.'  '  Bie 
surface  in  the  neighborhood  of  the  pptinma  is  quite  suitable  for 
these  methods. 

There  is  one  curious  feature  about  the  model  in  its  ability  to 
forecast  a  number  of  periods  in-to  the  fut\xre.  If  one  examines  the 
standard  deviation  of  forecast  errors  for  one -period-ahead  forecasts, 
for  two-period-ahead  forecasts,  and  so  on,  one  finds  results  which 
typically  look  like  Fig.  2.  Counter  to  our  expectations,  actmlly 
went  down  (althou^  not  sitbs-tantially}  for  the  first  few  months  out. 
This  suggests  an  auto-correlation  in  the  data  or  the  model  that  we 
are  not  handling  properly.  At  least  it  is  intxiitively  appealing  that 
the  nearer  the  period  being  forecast,  the  more  accurate  the  forecast 
should  be. 


0  6  12  k  months  in  future 


Wig.  2 
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suocatsTicats  for  application 

Because  a  full-fledged  testliag  of  the  model  and  searching  for 
optlsRim  weights  for  a  partlc\Uar  series  requires  a  substantial  amount 
of  past  history,  wd  also  a  good  bit  of  coasting  time.  It  seems 
reuonable  to  euuilyze  only  a  sainple  of  the  products.  Our  experience 
shows  that  approximately  the  sane  A,  B,  C  weights  are  optimal  for  a 
wide  range  of  products;  It  Is  reasonable  to  use  the  sane  A,  B,  C 
weights  for  groupings  of  products  at  any  rate.  In  addition,  several 
studies  Indicate  that  the  coefficient  of  variation  Is  constant  over 
a  wide  range  of  products  and  sales  levels.  In  one  application  for 
the  Wear-Ever  division  of  the  Aluminum  Company  of  America  we  were 
able  to  describe  two  groups  of  products,  s\ich  that  within  each  the 
coefficient  of  veurlatlon  could  be  assumed  to  be  constant. 

Some  measure  of  control  over  the  forecast  seems  advisable.  One 

device  that  Is  suggested  Is  an  exponentleilly  weighted  estimate  of  the 

vaorlance  of  forecast  error  irtilch  would  require  saving  a  couple  of 

2 

extra  pieces  of  Information  for  each  product  ((f  and  the  most  recent 
forecast) .  If  the  current  estimate  of  the  standard  deviation  becomes 
either  surprisingly  high  or  lew,  cospared  with  the  Initial  estimate, 
then  something  can  be  done  both  about  the  forecasting  procedure,  and 
also  about  the  forecast 's  use.  For  exaqple.  If  the  forecast  Is  being 
used  for  Inventory  control,  then  buffer  levels  or  trigger  levels  can 
be  changed. 

Chapter  1^  of  Ref.  7  gives  an  analyals  of  the  distributions  of 
forecast  errors.  The  work  given  In  this  chapter  concludes  that  dis¬ 
tributions  of  sales  are  quite  skawedj  particularly  for  low-selling 
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Items,  and  ttast  these  distributions  may  be  ressonsbly  approximated  by 
the  Oanma  and  the  log-normal,  with  the  Poisson  being  a  reasonable 
approximation,  but  not  as  good  as  the  first  two.  Of  course  the  choice 
of  approKlmatl(»i  here  depends  upon  the  model  in  which  the  foreoast 
will  be  used. 


r 
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AFFEDSIX 


Following  are  exeexpts  trca  the  tvo  Duff in  papers: 


BCERAFOUTOR  AND  SCRUTATOR 


(1) 


The  funotlon  to  he  minimized  is  a  weighted  aim  of  squared  errors 

2 


min  B  »  y  e“  [y  -  P(n)l 
n*l 


where  n  counts  time  into  the  past:  n^l  is  the  current  period,  n>2 
is  last  period,  etc.;  is  observed  value  in  period  n,  and 


m-1 


p(n)  -  a^  +  aj^n  +  ...  + 


The  extrapolated  forecast  for  next  period  is  given  in  general  by  the 
"short  formula": 


(2) 


for  exssple,  if 

y*  »  3(yi  +  o6i)  -  3(y2  +  ^^69)  *  (^3  *^63) 

with  d>]t  “  yjt  "  error  in  prediction  in  period  k.  The  short 

formula  appears  to  require  saving  2  pieces  of  information  for  each  of 
(m-l)  periods  in  the  past.  However,  for  m^3 

y*  -  2(yj^  +  -  (yg  +  8^63) 


Same  as  proposed  by  D.  A.  D'Esppo  in  "A  Note  on  Forecasting  hy  the 
Bbq^entlal  aaoothlng  Operator,"  Journal  of  the  Operations  Research  Society 
of  America,  Septsmber-October,  1961. 
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whieh  rcduoM  to 

y*  =  2(1  -  e)yj^  +  ae  y*  -  (1  -  id^)y^  -  d^y* 

^  r  2  2  *  T 

where  it  Is  possible  to  save  y^  and  A  =  1(1  -  6  )yj^  +  ®  yj^J  for 
tise  next  period,  or  only  2  pieces  of  data  for  a  second-order  polyno¬ 
mial.  I  don't  know  if  this  generaJLizes  for  hi^er  order  polynomials, 
but  since  the  functional  E  is  precisely  the  same  as  Brown's,  I  would 
guess  that  it  would. 

EKPOWOMIAL  ECTRAPOLATOR 

The  data  is  fitted  with  generalized  polynomials 

(3)  p(x)  -  p  xjjrj* 

where  thej^^  are  fixed  coaplex  numbers.  The  functional  is  similar 
to  (1); 

min  E  «  l^n  *  I  ^  * 

Ouffin  develops  a  parallel  short  formula 

»i  ■  -  f  *k  Vx  -  *  fl  Vk 

with 
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§2  “  C  fi'k.  *  J  ^  ^  » 

■  •  •  j3:'  • 

Duffln  then  develops  the  variance  of  the  estimate  for  several  eases, 
and  Indicates  some  assiimptlons  under  which  the  ertrapolation  is  a 
■axlimmi  likelihood  estimate. 

One  enaple  of  the  use  of  coiqplex  nunibers  gives 

p(x)  «  a^  +  I'*.  cos/j^x  +  hj^  sln^^x)  . 


If  M  -  1 


M 

p(x)  «  a^  +  Z  (a^  C08>>J^  X  +  hj^  sin  x)  . 


The  short  formulm  is 

y*  “  ^  ^^1  ®  6i)  “  62)  +  (y3  +  ^^63) 


with  A  >  1  -t-  2  cos  The  construction  here  parallels  the  short 

formula  in  Eq.  2.  This  work  is  essentially  the 
that  Brown  has  independently  developed. 


as  the  foraulatlon 
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DEMAND  PREDICTION:  A  COMMERCIAL  VIEWPOINT 

Winston  C.  Dalleck 
McKinsey  &  Company,  Inc. 

Spare  parts  demand  prediction  as  it  is  being  discussed  at  this 
conference  is  a  particular  problem  dealing  with  parts  usage  behavior 
in  aircraft,  mostly  military  aircraft.  However,  the  practical  aspects 
involved  here  —  the  determination  of  demand  patterns,  development  of 
forecasting  techniques,  and  meas\irement  of  forecast  errors  --  are  akin 
to  many  other  problems  involving  item  demand  prediction.  Thus  it  is 
not  altogether  inappropriate  at  this  meeting  to  comment  on  some  of  the 
more  general  and  commerical  forecasting  problems  we  encounter. 

One  statement  of  definition  seems  in  order  at  the  outset.  In 
dealing  with  forecasting  problems  we  recognize,  as  was  pointed  out 
earlier,  that  both  a  projection  and  prediction  are  usually  involved  — 
the  former  being  an  examination  and  extrapolation  of  history  and  the 
latter  a  provision  to  account  for  new  or  additional  effects  such  as 
promotional  effort,  price  change,  competition,  a  revision  of  the 
distribution  setup,  and  the  like. 

Our  forecasting  experience  has  been  comnercial  rather  than 
military,  and  is  of  two  types.  The  first,  and  the  one  encoiantered 
most  frequently,  concerns  corporate  sales  forecasting.  The  second 
type  involves  item  forecasting  for  such  puarposes  as  inventory  manage¬ 
ment  and  production  planning. 

Corporate  sales  forecasting  as  we  see  it  is  a  key  element  in 
total  integrated  planning  and  control.  A  sales  foreceist  is  the  link 
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between  planning  and  control.  First  it  provides  a  quantitative 
statement  of  the  revenue- generating  potential  of  a  corporate  plan. 

After  the  fact  it  becomes  the  basis  for  evaluating  performance  in 
implementing  these  plans  and  achieving  the  sales  objective. 

This  seems  such  an  obvious  requirement  for  doing  business  that 
one  might  wonder  why  sales  planning  —  sales  forecasting  if  you 
please  —  is  a  problem.  The  fact  of  the  matter  is  that  many  companies 
do  very  little  such  sales  planning.  Many  others  do  some  forecasting 
but  the  result  is  ineffectual.  It  is  not  uncommon  to  find  the 
following  situations  existing  in  a  company:  forecasting  responsibility 
is  not  clearly  designated;  several  forecasts  are  being  made  and  not 
properly  coordinated;  sales  forecasts  do  not  adequately  reflect  opera¬ 
ting  plans;  budgets  are  not  consistent  with  forecast;  effective  coordi¬ 
nation  of  promotional  programs  and  new  product  development  is  lacking. 

An  example  or  two  might  be  of  interest  here.  One  company  planned 
a  sales  program  and  made  a  forecast  which  represented  a  substantial 
increase  in  sales  over  the  previous  year.  They  failed  to  meet  the 
forecast  and  upon  examination  found  that  one  of  the  large  sales 
districts  had  cut  back  their  sales  force  for  other  reasons  —  to  cut 
costs  in  compliance  with  another  program  —  and  was  unable  to  build 
back  the  sales  force  in  sufficient  time  to  make  their  quota,  their 
share  of  the  sales  forecast. 

Another  instance  involves  a  large  distributing  company  with 
several  satellite  warehouses.  It  was  the  policy  of  this  company  that 
these  field  warehouses  replenish  their  Inventories  directly  from 
vendors  and  draw  on  the  main  warehouse  inventory  only  in  cases  of 
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emergency.  However,  the  monitoring  of  this  procedure  was  not  very 
effective.  Since  each  warehouse,  including  the  central  warehouse, 
was  treated  as  an  independent  profit  center,  the  field  warehouses 
found  it  to  their  advantage  to  replenish  frequently  from  the  central 
warehouse,  thereby  keeping  their  own  inventories  low,  but  at  the  same 
time  creating  unrealistic  demands  and  high  inventories  at  the  central 
warehouse  which  were  not  optimal  for  the  system. 

The  second  type  of  problem  encountered  involves  item  analysis 
and  forecasting.  Our  concern  is  with  such  activities  as  production 
planning  and  inventory  management  where  it  is  necessary  to  set  pro¬ 
duction  rates,  determine  economic  lot-sizes,  set  reorder  points,  and 
fix  safety  stock  requirements.  Here  the  problem  is  akin  to  that  of 
spare  parts.  Item  demand  data  must  be  collected  and  analyzed.  It  is 
necessary  then  to  determine  demand  patterns,  develop  forecasting 
techniques,  and  devise  ways  of  measuring  and  evaliaating  forecast 
errors . 

This  is  not  to  say  that  the  total  corporate  sales  forecast  and 
item  forecasts  are  unrelated.  We  believe,  in  fact,  that  it  is  imprac¬ 
tical  to  consider  them  separately  as  is  frequently  done.  This  fairly 
common  difficulty  can  be  characterized  by  an  example  involving  a 
large  producer  and  distributor  of  consumer  products.  This  company 
periodically  plans  very  detailed  sales-call  programs,  indicating  the 
specific  products  and  type  of  customers  which  should  get  the  attention 
of  field  sales  people.  In  the  case  in  question  a  significant  shift 
was  made  in  product  emphasis  from  the  previous  program  without  this 
information  being  conveyed  to  the  ’people  responsible  for  making  item 
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forecasts  for  production  planning  purposes.  As  you  might  expect 
the  forecasts  were  incorrect  and  the  result  was  an  imbalance  in 
production  scheduling  and  subsequently  in  item  inventorjes. 

In  contributing  to  the  general  discussion  of  item  demand  fore¬ 
casting,  I  would  like  now  to  review  three  of  our  forecasting  experi¬ 
ences  to  demonstrate  the  kind  of  problems  which  arise  and  how  we  have 
attempted  to  deal  with  them.  These  are  three  very  brief  case  studies. 

The  first  concerns  a  division  of  a  large  pharmaceutical  Company  X 
producing  about  200  items,  each  of  which  has  a  high  seasonal  demand 
pattern  and,  in  many  cases,  a  significant  trend  reflecting  increasing 
or  decreasing  demand  in  the  market  place.  Item  forecasts  are  made 
quarterly  for  production  planning  pui^oses,  each  forecast  being 
monthly  for  eight  months  ahead.  The  method  which  had  been  used  was 
12  months  moving  average,  the  results  of  which  were  satisfactory. 

The  purpose  in  going  to  another,  more  quantitative  and  formal 
method  of  item  forecasting  was  to  provide  a  good  base  projection 
from  which  to  evaluate  the  effect  of  subjective  judgments  being 
introduced  into  the  final  forecast.  In  addition,  the  company *s  EDP 
program  was  taking  shape  and  it  was  timely  to  consider  how  data 
processing  equipment  could  be  tied  into  the  forecasting  process. 

An  exponential  smoothing  model  was  used  and  proved  to  be  very 
effective.  The  model  used  is  the  one  developed  by  Professor  Winters 
of  the  Carnegie  Institute  of  Technology.  In  this  model  S^,  the 
estimate  of  the  sales  rate  in  period  t,  is  computed  as  an  Initializing 
step, 

* 

Peter  R.  Wnters,  "Forecasting  Sales  by  E^qponentlally  Wel^ted 
Mo^ng  Averages,"  Management  Science,  fpril,  i960,  p.  324. 
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where  A  is  the  smoothing  constant  and  the  wei^ts  B  and  C  are  \ased  i 

in  separate  calculations  to  revise  respectively  F  (the  seasonal 
factor)  and  R  (the  trend  factor)  until  one  is  reeuiy  to  begin  making 
forecasts.  Then 

T  "  ™t]  ^t-L  +  T  '  T  =  1,  2,  . . L 

is  used  to  make  these  forecasts. 

As  you  are  aware,  this  model  is  designed  to  lose  historical  sales 
data  as  a  way  of  evalxiating  different  sets  of  weights  --  the  ABCs  -- 
in  order  to  determine  which  set  is  best.  Since  a  four  year  history 
of  sales  was  available  for  each  item  we  were  able  to  initialize  over 
the  first  two  years  and  forecast  the  last  two  years.  This  step  is 
portrayed  in  Fig.  1. 

Item  A 


15,000 

10,000 

5,000 

1957  1956  1959  I960  1961 

Fig.1 — Item  demond  history  for  testing  forecasting  method 
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Fig.  2  — Actual  demand 
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Fig.  3  —  Actual  demand  compared  to 
company  forecast 

(  Forecasting  8  months  ahead) 


Fig.  4  —  Actual  demand  cam  pared  to 
exponential  forecast 
(  Forecasting  8  months  ahead ) 
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Using  the  model  as  indicated  it  was  possible  to  try  many  sets 
of  ABC  weights  and  evaluate  each  one  in  terms  of  the  forecast  error. 
This  is  done  in  three  ways:  by  computing  an  average  fractional  error, 
the  standard  deviation,  and  the  coefficient  of  variation.  We  found 
the  latter  statistic  to  be  the  most  useful. 

The  results  achieved  with  the  Winters  model  were  very  good.  Co¬ 
efficients  of  variation  frequently  were  as  low  as  0.07  to  0.09  and 
rarely  were  they  larger  than  0.15.  A  look  at  a  typical  item  will 
provide  a  graphical  indication  of  the  accurate  forecast  made  using 
the  exponential  smoothing  model  compared  with  a  forecast  made  based 
on  a  12-month  moving  average.  In  Fig.  2  the  actual  sales  for  ein 
Item  A  are  shown  for,  the  last  two  years  of  the  four-year  period. 

In  Figs.  3  and  4  the  actual  sales  are  plotted  and,  in  addition,  the 
forecasts  have  been  simulated  with  each  quarterly  forecast  (for  8 
months  ahead)  being  shown.  Figure  3  compares  the  company* s  12Hnonth 
moving  average  forecast  with  actual;  Fig.  4  compares  the  exponential 
forecast  with  actual. 

The  division  of  this  pharmaceutical  company  is  proceeding  as 
of  the  beginning  of  1962  to  do  their  item  forecasting  using  the 
exponential  smoothing  model.  It  is  basically  Professor  Winters* 
model  with  a  modification  to  eliminate  an  existing  stop  in  the 
program  necessitated  by  the  requirement  to  have  an  actual  sales 
figure  in  each  period  to  be  compared  with  the  forecast  in  computing 
a  forecast  error. 

Company  I,  a  second  case,  is  a  large  wholesale  and  retail 
distributor  of  metal  materials  and  metal  products.  Their  inventory 
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is  comprised  of  approximately  10,000  items.  Demand  for  these  items 
is  highly  variable  with  little  trend  or  seasonal  pattern  present.  In 
addition,  the  replenishment  leadtime  is  highly  variable.  The  records 
for  about  70  per  cent  of  the  inventory  —  in  terms  of  value  —  are 
maintained  in  a  set  of  Kardex  files.  The  records  of  the  remainder  of 
the  inventory,  mostly  tools  and  supplies  materials,  are  being  converted 
to  an  IBM  305  system.  The  problem  of  concern  here  was  to  provide  a 
sound  and  systematic  way  to  review  and,  if  necessax*y,  recalculate 
the  item  reorder  points. 

The  problem,  of  course,  is  not  unique.  There  were  two  difficul¬ 
ties,  however,  in  dealing  with  this  particular  problem.  The  first 
was  one  involving  the  considerable  workload  required  to  do  the  neces¬ 
sary  analysis  and  computational  work  for  such  a  large  nimiber  of  items. 

In  the  second  case,  there  was  some  difficulty  in  establishing 
statistical  demand  patterns.  Taking  a  week  as  the  useful  demand 
period,  it  was  found  that  some  demand  patterns  appeared  to  be  normal, 
others  the  Poisson  type,  and  still  others  the  gamma  type.  The  analysis 
work  required  to  develop  and  select  an  appropriate  demand  pattern  proved 
too  difficult  —  for  several  practical  reasons  —  for  the  client 
people  to  deal  with.  In  lieu  of  this  step  a  Monte  Carlo  routine  was 
developed  to  compute  the  cumulative  probability  distribution  of  usaige 
during  leadtime  for  each  item  based  on  the  actual  demand  and  replenish¬ 
ment  leadtime  data. 

This  routine  is  a  Monte  Carlo  version  of  the  following  polynomial. 

t 

P(u)  =  |p(xi)  +  P(x2^  +  .  .  .  +p(Xn^J 
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If  one  can  assume  that  the  actual  individual  distributions  being  used 
are  descriptive  of  the  item  depletion  and  replenishment  behavior,  then 
the  distribution  resulting  from  the  combination  of  these  two  will 
indicate  the  probability  of  a  stock  shortage  occurring  at  any  given 
point  or  replenishment  level.  Fig.  5  shows  this  distribution  in  the 
form  of  a  c\xmulative  probability  of  usage  during  leadtime. 

Since  only  the  right-hand  tail  of  this  distribution  is  important 
to  us,  it  is  necessary  that  the  Monte  Carlo  sample  size  be  large 
enou^  to  assure  that  the  tail  is  stabilized.  The  computer  routine 
requires  only  a  few  seconds  to  make  the  calculation;  thus  we  have 
found  it  convenient  to  use  sample  sizes  of  one  thoiisand.  This  is 
not  only  adequate  usually  for  statistical  stability,  but  also  provides 
a  frequency  count  expressed  directly  as  percentages- 


Fig. 5 — Probability  of  utagt  during  leadtime 


/ 
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At  a  relatively  small  cost  this  computing  routine  can  be  used 
to  develop  a  large  number  of  distributions  for  the  probability  of 
usage  during  leadtime  which  can  then  be  classified  and  applied  directly 
in  determining  the  reorder  points  for  most  of  the  items  in  the  inven¬ 
tory. 

The  third  case  involves  Company  Z  which  we  mention  primarily 
because  this  situation  typifies  a  problem  occurring  frequently  amongst 
our  clients.  This  company  produces  several  hundred  items  in  a  number 
of  plants  for  national  distribution.  A  linear  programming  model  was 
developed  to  help  in  improving  the  production  planning  process.  In 
the  development  of  a  dynamic  version  of  this  model  —  one  that  would 
make  monthly  production  allocations  over  a  period  of  several  months  -- 
it  was  necessary  to  provide  monthly  item  demand  forecasts  for  each 
market  area.  These  item  forecasts  were  not  being  made  nor  were  there 
any  records  of  item  demand  history  from  which  to  develop  such  forecasts. 
Only  aggregate  forecasts  were  being  made  with  the  total  being  allocated 
or  ratioed  to  each  item.  This  is  a  relatively  unsatisfactory  way  of 
developing  item  forecasts,  and  it  has  been  found  on  initial  trial  that 
the  exponential  smoothing  technique  provides  a  satisfactory  approach 
to  forecasting  demands  for  at  least  the  large  volume  items  even  in 
the  absence  of  much  \isable  historical  data. 

These  case  examples  typify  the  majority  of  Item  forecasting 
problems  we  have  encountered.  As  you  can  see,  the  resolution  of  these 
problems  depends  on  the  availability  of  data,  the  capability  of  client 
people  to  deal  effectively  with  somewhat  more  sophisticated  forecasting 
techniques,  and  a  careftal  economic  evalmtion  of  the  degree  of 
soi^iistication  warranted  in  any  given  problem  situation. 
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One  of  the  objectives  of  this  conference  is  to  outline  questions 
in  areas  of  future  work.  I  would  like  to  suggest  a  few  which,  from 
our  point  of  view,  seem  important.  First,  I  believe  more  attention 
should  be  given  to  a  consideration  of  how  good  a  forecast  must  be  in 
any  given  situation.  Accuracy  in  forecasting  costs  money  and  one 
should  attempt  to  be  only  as  accurate  or  detailed  as  his  related 
decision-making  capabilities  will  justify. 

Second,  more  work  is  needed  in  developing  models  and  methods 
for  dealing  with  outside  effects,  that  is,  the  projection  phase  of 
forecasting.  Finally,  more  recognition  should  be  given  to  the  problem 
of  appraising  and  developing  specific  technical  competence  in  user- 
organizations  to  assure  that  refinements  in  forecasting  technique  as 
developed  and  implemented  will  be  monitored  and  maintained  effectively. 

This  has  been  a  highly  useful  conference,  and  it  is  a  privilege 
to  be  able  to  attend  and  participate.  I  wo\ild  strongly  favor  the 
planning  of  similar  conferences  for  the  future,  and  in  doing  this, 
would  suggest  that  they  be  broadened  to  include  more  representation 
from  the  business  and  indoos triad,  field. 
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SOME  REM/IRKS  ON  SPECTRAL  ANALYSIS 

George  S.  Fishman 
Stanford  University 

For  the  past  seven  months,  I  have  been  assisting  Professor 
Marc  Nerlove  of  Stanford  University  in  a  study  of  hog  and  cattle 
slau^ter  in  the  United  States.  We  have  been  interested  in  deter¬ 
mining  the  relative  importance  of  cyclical  and  seasonal  phenomena 
in  the  monthly  time  series  of  hog  and  cattle  slau^ter.  This  was 
done  by  estimating  the  power  spectrum  associated  with  each  of  the 
economic  time  series.  The  estimation  procedures  used  come  under  the 
heading  of  spectral  analysis. 

I  woiiLd  like  to  spend  my  time  this  afternoon  giving  a  brief 
description  of  the  theory  behind  the  concept  of  the  power  spectrum, 
outlining  the  procedures  used  when  estimating  the  power  spectrum, 
and  giving  an  example  of  the  simplification  which  can  be  achieved  in 
the  theory  of  filtering  by  working  in  the  frequency  domain  rather 
than  the  time  domain.  By  filtering  we  mean  the  elimination  of  cycliced 
or  seasonal  components  from  the  time  series. 

We  know  that  a  periodic  function  of  time,  g(t)  ,  with  mean  zero, 
may  be  represented  by  a  linear  combination  of  sines  and  cosines, 
a  00 

(l)  6(t)  =  ^  +  ZZ  (fiLn  cos  nWj^t  +  sin  n  t)  , 

n=l 

eubject  to  the  condition  that  g(t)  be  absolutely  integrable, 

I  jg(t) )  dt  <  « 

J-Tj^/2 


(2) 
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The  coefficients  in  (l)  are  given  by 


(3a) 

2 

^n  ^ 

fT  /2 

1  g( t)  cos  n  M. t  dt 

J-Tj^/2  ^ 

and 

^l/2 

(3b) 

2 

’^n  "  T^ 

\  g(t)  sin  niS-t  dt 

J.T,/2  1 

is  the  fundamental  frequency  of  the  period  and  is  defined 


as  follows; 


Manipulation  of  relationships  (l),  (3a),  and  (3t)  yields 

00  in«L  t 

(5)  g(t)  =  YI1 

n=-aD 

where 

(6)  F(n)  =  -  ib^),  n  =  0,  +1,  +  2, . . . 

and 

rT  /2  -inlilt 

(7)  F(n)  \  ^  g(t)e  ^  dt,  n  =  0,  +1,  +2,  . . .  . 

^1  J-T^/2 

F(n)  is  the  Fourier  transform  of  g(t).  F(n)  is  complex  and  discrete 
for  periodic  functions*  It  assumes  non-zero  values  only  at  integer 
V6^.ues  of  n. 


The  autocovariance  function  for  g(t)  is 
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(8) 


■rf 

iJ-T. 


T^/2 


'l/2 


g(t)  g.(t+r)dt 


Replacing  g(t+tf)  by  its  Foiorier  transform,  we  have 

;i/2 

(9)  (<(r) 


,  f  00  in<M(t4tO 

-k  g(t)2I  F(n)e  ^  dt 


P^/2 


n=-oo 


.  00  initt  T  f  ; 

-i  z  f(”)»  / 

1  n=-a3  «/-T 


i«u  T  inWt 

^  '  g(t)e  ^  dt  , 


l/2 


and  by  comparing  the  expression  under  the  integral  sign  with  (7),  we 
see  that 


(10) 


-  r 


inrt  t 

g(t)e  dt  =  F(-n)  . 

l/2 


It  can  be  shown  that  F(-n)  is  the  complex  conjugate  of  F(n).  Let 
the  complex  conjugate  of  F(n)  be  denoted  by  f^(n).  Therefore,  (9) 
is  eq^uivalent  to 

00  inulf  00  2 

(11)  5^(t)=E  F(n)  F  (n)e  ^  |F(n)|  e 

n=-aD  n=-CD 


At  T  =  0,  we  have 

(12)  ?((0)  |F(n)| 

n=-CD 

<^{0)  is  the  variance  of  the  time  series  g(t)  .  It  is  equal  to  the 
sum  of  the  squared  absolute  values  of  the  spectral  components  of  g(t) 
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Therefore, 


is  the  relative  contribution  to  the  variance  of 


g(t)  maxie  by  the  frequency 

|F(k)|^  is  the  contribution  of  frequency  kuij^  to  the  power 
spectrum  of  g(t)  .  let  us  denote  it  by  P(k)  .  The  power  spectrum 
is  real,  symmetrical  about  k  =  0  ,  and  discrete  for  periodic  functions. 
We  are  interested  in  estimating  these  spectral  components,  P(k),  for 
all  k  ,  from  our  time  series  so  that  we  may  discern  the  relative 
importance  of  different  frequencies. 

The  case  of  aperiodic  functions  is  analyzed  by  means  of  an 
extension  of  the  periodic  case.  We  allow  the  fundamental  frequency 
to  approach  infinity.  This  defines  the  aperiodic  function  as  an 
infinite  wei^ted  sum  of  periodic  functions.  Then  becomes  the 
infinitesimal  do)  and  n«j^  becomes  Therefore,  (5)  and  (T)  become 


(13) 


d« 


(ll^) 


F(«) 


dt, 


respectively. 


The  autocovariance  function  of  an  aperiodic  function  g(t)  is 
given  by 


(15) 


9((T) 


g(t)  g(t+T)dt. 


Replacing  g(t+T)  by  its  spectral  representation,  we  have 
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(l6a) 

(l6b) 


Note  that  the  integral, 

roD  .  . 

g(t)e^dt 

J  -00 

is  the  complex  conjugate  of  F(uji)  multiplied  by  2K 
consequence  of  (l4). 


Let 

(IT) 

At  X  =  0,  we  have 

(18) 


p(w)  =  2rt|F(w)p  . 


(■CD 

9((0)  =  ] 

J  -CD 


P(«)dw  • 


This  is  a 


P(W) 

g(t) 


is  the  power  density  spectrum  of  the  aperiodic  time  function 
p(w  )d<U 

.  Therefore,  -rr -  measures  the  relative  contribution  to 


f°^P(ci)d(0 

J  -00 


the  variance  made  by  frequency  real,  symmetrial 

about  0)=  0,  and  is  continuous  for  completely  aperiodic  functions. 

The  power  spectrum  for  a  function  containing  both  periodic  and 
aperiodic  components  is  shown  in  Fig.  1.  The  discrete  impulses  are 


attributable  to  the  periodic  components  of  the  time  function,  and  the 


V 
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p(*^) 


Fig.  1 


continuous  part  is  attributable  to  the  aperiodic  component.*  Note 
that 

(19)  (^iX)  =  P(«)e"^‘^  d«  . 

That  is,  P(4))  is  the  Foxarier  transform  of  the  autocovaxiance 
fimction  • 

Many  problems  arise  when  we  attempt  to  estimate  the  power 
spectrimi.  The  first  difficulty  to  be  considered  is  often  referred 
to  as  "aliasing.**  This  problem  is  made  apparent  by  the  following 


Strictly  speaking,  the  discrete  impvilses  shown  in  Fig.  1  are 
quantities  with  a  dimensionality  different  from  that  of  P(4i)  itself. 
These  discrete  components  have  the  dimensionality  of  P(toi)dw  ,  and 
they  have  been  drawn  in  the  same  diagram  with  the  continuoios  P(ii) 
merely  for  visual  convenience. 
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hypothetical  example:  Suppose  that  a  Martian  is  interested  in  deter¬ 
mining  how  often  we  have  Congressional  elections  here  in  the  United 
States.  Let  us  assume  that  he  takes  observations  of  political  life 
in  the  United  States  only  in  calendar  years  divisible  by  four.  He 
may  conclude  from  his  observations  that  we  have  Congressional  elections 
every  four  years.  However,  it  is  clear  that  this  conclusion  is 
not  quite  adequate  since  his  observations  cannot  discern  whether  or 
not  Congressional  elections  are  held  every  two  years  or  every  year. 

This  results  from  the  fact  that  his  observations  are  being  taken  at 
equal  spaced  intervals  of  four  years.  *  Analogously,  we  are  unable, 
in  spectral  analysis,  to  distinguish  between  the  contributions  to  the 
power  spectrum  made  byci^^,  etc.  (see  Fig.  2)  since 

observations  are  made  at  equally  spaced  intervals  of  length  At. 


Fig.  2 


In  the  case  of  monthly  data,  the  highest  frequency  for  which  we  can 
clearly  determine  the  power  is  ^  ,  the  frequency  associated  with  a 
period  of  two  months. 


! 
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In  general,  we  space  our  observations  in  such  a  way  that  we 
would  expect  the  power  associated  with  the  frequencies  greater  than  JT 
to  be  relatively  negligible.  We  therefore  do  not  treat  aliasing  as 
a  critical  problem  when  estimating  the  power  spectrum.  Nevertheless, 
ve  should  be  aware  of  its  existence. 

In  estimating  the  spectrum,  we  are  interested  in  deriving  sample 
estimates  of  the  power  spectrum  associated  with  a  time  series  X. .  We 
assume  that  has  a  zero  mean  and  that  E(X^  ^t-fV^  independent 
of  t.  From  the  aforementioned  theoretical  description,  one  would 
expect  the  spectral  estimates  to  be  of  the  form 

(20)  [2  R(V)  cos  w^V  +  R(0)]  , 

where  n  is  the  number  of  observations  in  the  seimple,  R(v)  Is  the 
estimated  autocovariance  for  a  lag  of  y  months,  and  is  defined  as 

/  \  ,  n^ 

(21)  r("^V)  h  • 

(n) 

Note  that  as  it  is  written  is  a  biased  estimator  of  the 

autocovariance,  R(v).  It  is  preferred  to  an  unbiased  estimator 
where  the  denominator  is  n-V  rather  than  n  ,  for  two  reasons: 

(1)  to  achieve  a  minimiam  mean  square  error,  and  (2)  to  achieve  a 
positive  definite  estimate  function.  The  necessity  for  this  second 
property  derives  from  the  fact  that  the  true  power  spectrum  is 
everywhere  greater  than  zero,  and  the  unbiased  estimate  of  R(v) 
may  yield  negative  values  for  the  estimated  power  spectrum  at  some 


frequencies . 
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Unfortunately,  estimates  of  the  spectrum  based  on  (20)  lack  the 
desirable  statistical  property  of  consistency.  That  is,  if  a  number 
of  samples,  each  with  an  infinite  number  of  observations  per  sample, 
were  used  to  derive  separate  spectral  estimates  for  frequency  , 
one  would  find  that  these  sample  estimates,  based  on  this  infinity 
of  observations,  would  not  come  out  to  be  equal  to  the  number  P(too)» 
but  rather  would  form  a  random  scatter  around  P(Wq)  and  have  an 
exponential  probability  distribution. 

In  194*8,  Bartlett  pointed  out  that  if  one  were  to  divide  a 
sample  of  n  observations  into  p  sets,  each  containing  m  obser¬ 
vations,  and  then  derive  sample  estiirates  of  the  spectrum  for  each 
set  and  average  the  power  estimates  for  the  frequency  co^  over  all 
sets,  one  would  have  a  consistent  estimate  of  the  true  spectral 
average  centered  at  .  It  can  be  shown  that  this  procedure  is 

equivalent  to  introducing  a  wei^ting  function  in  (20)  such  that 

/  \  -  m 

(22)  ^Av  ^  ^  cos  c^V  +  R(0)] 

where 

(23)  \  ^  ■  m 

=  0  elsewhere. 

Since  1948,  much  work  has  been  done  on  other  types  of  weighting 
functions  which  have  come  to  be  called  windows  in  the  technical 


literature.  It  has  been  shown  that 
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(24)  lim  r  A(«a)dw=  f  P(<*>)  A(«)  dca  , 

n-^oD  Jo 

vhere  A((i))  is  the  window  used  to  derive  the  estimates  of  the  true 
spectral  averages.  What  (24)  says  is  that  the  sample  spectral 
average  is,  indeed,  a  consistent  estimate  of  the  true  spectral 
average . 

It  can  be  shown  that  (24)  leads  to 

4v  =k 

vhere  k(^)  is  the  Fourier  transform  of  A(«) . 

One  chooses  a  window  A(w)  vhich  will  wei^t  the  spectral  esti¬ 
mates  close  to  0)^  as  heavily  as  possible.  In  this  way,  the  estimated 
spectral  averages  will  be  more  representative  of  the  true  power  at 
gain  thjs  desirable  property  of  resolution,  one  must 
sacrifice  another  desirable  property,  namely,  stability.  That  is, 
the  gre'  the  number  of  lagged  contributions  contained  in  the  esti¬ 
mate''  ,ectral  average,  the  better  the  resolution,  but  the  poorer 
t>  .ean-S(luare  error  of  the  estimate  of  the  true  spectral  average. 

one  sees  that  we  must  so  choose  the  nimiber  of  lags  in  the  window 
to  yield  some  compromise  between  resolution  and  stability. 

The  adjustment  of  economic  time  series  to  eliminate  seasonal 
phenomena  has  long  been  a  topic  of  interest  to  economists.  This 
filtering  process  can  be  greatly  simplified  theoretically  if  one 
analyzes  the  time  series  in  the  frequency  domain  rather  than  directly 


in  the  time  domain. 
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Let  g{t)  be  the  input  to  a  system  whose  response  to  a  unit 
impulse  is  h(t)  .  Let  f(t)  be  the  output  of  this  system.  If  g(t) 
were  a  unit  Impulse,  then 

(25)  f(t)  =  h(v)  g(t-v) 

would  be  the  output  response  to  a  unit  impulse  which  is  applied  to 
the  system  at  t  =  V  ,  where  h(v)  is  the  time  response  chairacterizing 
the  system  into  \diich  the  signal  is  fed. 

If  one  thinks  of  g{t)  as  a  series  of  impulses  forming  a 
continuous  signal,  (25)  becomes 

r 

(26)  f(t)  =  \  h(v)  g(t-v)dv  . 

J-00 

It  can  be  shown  that  the  Foiffier  representation  of  (26)  is 

(27)  F(fc»)  =  H(w)  G(w)  , 

where  F(u»),  G(a>)  are  the  Fourier  transforms  of  f(t),  h(t), 

and  g(t),  respectively.  This  leads  to 

(28)  Pj.(«)  =  |h(w)(^  P^(«)  . 

That  is,  the  power  density  spectrum  of  the  output  signal  is  simply 
the  power  density  spectrum  of  the  input  multiplied  by  j  H(cii)j^  . 

To  show  the  importance  of  (28)  in  problems  of  filtering  economic 
time  series,  we  consider  the  spectrxam  of  ,  where  is  an 

economic  time  series  In  which  ve  suspect  seasons^,  and  cyclical 


behavior  to  exist. 
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PgH 


Fig.  3 


Bie  discrete  in5>\alses  at  “  are  attributable  to 

the  seasonal  components  of  periods  of  12  and  6  months  in  X^.  The 
contributions  of  other  seasonal  frequencies  have  been  omitted  for 
simplicity. 

One  often  seeks  to  eliminate  these  impulses  when  attempting  to 
derive  a  seasonally  adjusting  economic  time  series.  For  many  time 

series,  the  contribution  of  the  continuoxis  spectrum  for  H>?  to  the 

•  6 

total  power  spectrvm  is  negligible.  Therefore,  a  reasonable  way  to 
eliminate  the  seasonal  behavior  is  to  define 


(29)  H(cu)  *  1  |U/)<  Wj, 

s  0  elsewhere. 

kr^ls  chosen  corbltrarlly  close  toT^/6,  the  lowest  seasonal  freq]tiency. 
Such  a  filter  will  modify  the  spectrisa  as  In  Pig.  4. 


This  eliminates  the  seasonal  components,  which  is  what  we  actually 
want. 


We  know  that  the  time  representation  of  H(w)  is 


(30) 


h(t) 


r 

J-a 


2it  J-oo 


sin  «  t 
_ o 

itt 


Therefore,  the  output  f(t)  is 

sin  V 

(31)  f(t)  J_^  g(t-v)dv  . 


An  attempt  has  been  made  to  use  a  close  approximation  of  the 
ideal  filter  in  (30).  However,  l8o  leads  and  l80  lags  are  needed  in 
the  resulting  wei^ted  average  in  order  to  obtain  a  minimum  level  of 


acceptability  for  the  adjxisted  series.  Ibis  is  obviously  impractical 
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since,  with  such  a  filter,  we  could  not  adjust  with  confidence  any 
data  in  our  time  series  beyond  1946. 

Ify  example  of  the  ideal  seasonal  filter  was  meant  to  show  the 
greater  simplicity  in  conceptualization  when  one  works  in  the 
frequency  domain.  Our  discouraging  results  in  approximating  the 
ideal  filter  ou^t  not  to  be  considered  exhaustive  of  all  possible 
alternatives . 

In  my  introductory  statement  I  mentioned  that  we  have  been  using 
spectral  analysis  on  hog  slau^ter  and  cattle  slau^ter  time  series. 
One  reason  for  concentrating  on  these  series  was  the  availability 
of  over  50  years  of  monthly  data  for  each  series.  Long  series  are 
preferred  in  spectral  analysis  in  order  to  derive  good  estimates  with 
the  desired  statistical  properties.  We  have  made  some  preliminary 
investigations  into  shorter  series  of  20  years.  Our  results  have 
been  favorable  and  we  feel  that  spectral  ansLlysis  may  be  applied  to 
many  economic  time  series  of  20-year  duration  with  success. 

This  presentation  has  certainly  not  been  all-incl\isive  of  the 
problems  of  spectral  estimation  and  filtering.  Much  remains  to  be 
mentioned.  However,  I  hope  that  the  reader  will  derive  some  minimal 
familieirity  with  spectral  analysis  and  \^at  it  offers  as  a  research 


tool. 
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THOUGHTS  EXPRESSED  AT  THE  CONESRENCE 

EVederlck  S.  Nowlan 
Uhited  Air  Lines* 

My  thoughts  are  somewhat  biased  since  it  seems  to  me  that  when 
we  are  studying  demand  figures  we  are,  in  effect,  studying  reliability 
characteristics  through  the  medium  of  demand  data. 

The  general  findings  that  demands  were  not  too  closely  correlated 
with  operational  usage  appears  somewhat  surprising  to  me  since  a 
generally  tused  reliability  index  is  the  ratio  of  iinscheduled  removals 
(these  give  rise  to  demands)  to  the  voliane  of  operational  usage. 

This  index  may  show  large  fluctuations  from  one  calendar  time 
period  to  another  but  further  technical  euialysis  frequently  can  explain 
much  of  this  variation,  laical  of  such  causes  of  major  fluctuations 
are: 

(1)  The  definition  of  satisfactory  performance.  We  freqioently 
are  very  demanding  during  the  initial  period  of  operation  of  new 
equipment  before  we  are  familiar  with  its  intrinsic  chsuracteristlcs . 

In  this  case  eqtilpment  is  "squawked"  and  removed  during  initial 
operations  for  reasons  that  will  not  lead  to  removal  and  demand 
creation  during  later  operation. 

(2)  Caiiq>algn  inspections  as  a  result  of  the  first  discovery  of 
unsatisfactory  conditions  sis  a  result  of  the  first  inspection  or 
failure  in  a  hidden  area  of  em  aircraft.  After  the  first  identification 
of  a  source  of  trouble  in  an  airplane,  the  resulting  campaign  Inspectioi 
can  lead  to  a  greatly  Incresised  replacement  rate  for  a  short  period  of  time. 

*lklnteimnce  Base,  San  Rmnclsco  International  Airport. 
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(3)  File  maintenance  procedures  which  Hail  to  identify  chronic 
airplanes  where  the  malfunction  is  not  being  corrected  by  unit  r^lace- 
ment  and  which  do  not  lead  to  the  more  thorough  trouble  shooting 
required  to  cure  the  problem. 

(4)  Component  modification.  Engineering  action  is  directed  at 
improving  the  reliability  of  components  with  high  replacement  action. 
Modification  may  be  very  successful  and  greatly  reduce  the  replacement 
rate.  On  the  other  hand  there  may  be  an  unsuccessful  modification. 

Biere  sure  of  coiorse  memy  other  factors  which  can  lead  to  more 
gradual  changes  in  removal  rate  and  the  dememd  level.  Such  factors  are: 

(1)  Overhaul  specifications  and  procedures. 

(2)  Overhaul  periodicity. 

(5)  Shop  quality  control  procedures. 

(4)  Operating  procedxares. 

(5)  Age  of  units  in  service,  etc. 

It  would  seem  that  all  these  reliability  considerations  would  make 
correlation  analysis  of  denand  data  rather  difficult.  ISie  analysis  of 
demand  data  would  seem  to  entail  very  close  liaison  with  people  con¬ 
cerned  with  component  reliability. 

Bils  might  be  difficult  to  achieve.  It  is  known,  however,  that 
very  extensive  reliability  studies  and  replacement  records  are  available 
for  the  Lockheed  Georgia  C-13O  and  some  of  the  Boeing  aircraft.  It 
might  be  possible  to  correlate  these  reliability  data  with  demand  data. 

Again,  large  bodies  of  data  exist  within  the  air  transport  indus¬ 
try  and  some  of  these  data  might  be  useful  for  general  ilaMind  prediction 


studies 
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SOME  THOUGHTS  ON  THE  DEMAND  PREDICTION  JOB  AHEAD* 

Emil  W.  Hamilton 

San  Bernardino  Air  Materiel  Area** 

THE  APPLICATION  OF  SELECTIVE  MAHAGIMINT  PRINCIPLES  TO  DEMAND 
PREDICTION 

One  conclusion  I*m  sure  we  would  all  agree  with  is  that  there  is 
no  "best  way"  to  predict  demand  or  forecast  future  needs.  There  are 
only  "preferred"  ways  —  and  these  will  vary  depending  upon  many 
circvunstances. 

This  calls  for  development  Of  Selective  Management  approaches 
wherein  suitable  demand  prediction  techniques  could  be  tailored  for 
application  to  groups  of  items  having  similar  technical  or  management 
characteristics.  We  have  moved  in  this  direction  in  the  last  few 
years,  but  the  groupings  are  largely  cost-oriented.  Within  these 
cost  breakouts  —  which  have  proved  their  merit  for  management  and 
control  piirposes  —  there  appears  to  be  quite  a  potential  for  further 
"slicing"  by  demand  or  volume  characteristics  to  give  us  a  better 
handle  on  the  forecasting  problem. 

LOW  DEMAND  ITEMS 

With  low  demand  items  predominating,  this  would  be  a  good  place 
to  start.  Here  we  have  unlimited  opportunities  for  mass  simplification 
of  data  collection,  program  elements,  factors  development,  computational 

♦This  paper  summarizes  some  remarks  made  by  the  author  at  the 
Conference. 


♦♦Norton  Air  Force  Base. 
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techniques,  etc.  Looking  ahead,  the  nature  and  size  of  future  weapons 
programs  portends  an  even  higher  ratio  of  low  demand  Items  than  in  the 
past. 

Today  there  is  much  waste  motion  at  provisionings  and  during 
replenishment  requirements  computations  as  people  (and  machines) 
wrestle  with  the  development  and  application  of  microscopic  factors 
that  frequently  lead  to  unrealistic  "sub -minimum”  quantities.  If  we 
fail  to  adjust  the  computed  answers,  we  trigger  a  whole  host  of 
unrealistic  actions  in  the  logistic  cycle.  If  we  do  adjust  the 
answer  to  something  more  realistic,  the  question  arises  about  whether 
we  couldn’t  have  gotten  this  final  more  defensible  answer  much  more 
easily  and  directly. 

Although  we  may  have  no  real  basis  for  a  "computation”  or  a 
"demand  prediction"  as  such  for  these  low  demand  items,  we  are  not 
free  of  the  job  of  making,  as  best  we  can,  a  "determination"  of  some 
reasonable  range  and  depth  of  items  that  m*ust,  for  a  variety  of 
reasons,  be  readily  available  if  ever  called  for.  Even  if  we  cannot 
be  as  objective  and  as  scientific  in  our  approach  here  as  some  would 
like,  I  believe  we  can  improve  on  what  we  do  today.  At  least  we 
sho\ald  be  able  to  sharpen  up  our  "qualitative/subjective"  approaches 
and  give  them  a  meajsure  of  recognition  and  respectability  that  will 
enhance  their  use  as  "tools  of  the  trade." 

What  appears  to  be  needed  is  some  well  chosen  criterion  for 
categorizing  items  as  low  demand  and  then  a  delineation  in  check  list 
form  of  the  various  "thought  processes"  that  need  to  be  taken  into 
account  in  the  decision  of  what  and  how  much  to  bring  into  the  system. 
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Thus  with  a  few  relatively  simple  approaches  —  not  so  much  mathematical¬ 
ly  or  statistically  oriented,  but  slanted  more  toward  better  delinea¬ 
tion  and  application  of  the  proper  "thought  processes"  —  we  should 
be  able  to  greatly  simplify  the  requirements  task  for  the  mass  of  low 
demand  items  in  the  various  cost  categories  and  at  the  same  time 
achieve  more  realism  in  the  resiolts. 

Perhaps  the  spirit  of  what  we  are  saying  is  embodied  in  the 
observation  of  one  of  the  Carnegie  representatives  when  he  said  that 
"...instead  of  trying  to  predict  specific  occurrences,  maybe  we  ought 
to  try  to  prescribe  the  parameters  that  evaluate  risks... then  we  are 
not  so  much  predicting  demand  as  predicting  risks..." 

HIGHER  DEMAND  ITEMS 

For  the  few  items  with  relatively  high  demand  characteristics, 
we  would  go  "all  out"  in  search  of  refined,  scientific  prediction 
techniques.  We  could  afford  for  this  more  manageable  number  of  items, 
the  more  e3q>ensive  data  collection  systems,  more  meaningful  program 
elements,  more  sophisticated  computational  methodologies,  etc.  This 
would  be  the  area  for  exploiting  further  many  of  the  types  of  formulae 
dlscxissed  at  the  conference. 

In  analyzing  such  approaches  with  a  view  toward  determining  their 
applicability,  we  should  be  less  concerned  with  the  numbers  of  items 
the  techniques  could  be  applied  to,  and  more  concerned  with  their 
potential  pay-off  in  relation  to  the  monetary  worth  and  mission  es¬ 
sentiality  of  the  specific  item  involved.  The  mere  fact  that  a  given 
technique  seems  to  work  best  for  most  of  the  items  is  not  sxifficlent 
reason  for  adopting  it  for  use  "across  the  board." 
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Here  the  challenge  shoiald  he  to  develop  the  capability  for 
associating  technical  knowledge  of  the  item  and  knowledge  of  relative 
merits  of  the  various  demand  prediction  techniques  to  permit  some 
fairly  judicious  choice  of  the  optimum  method  for  that  item.  This 
choice  mi^t  well  range  from  the  relatively  simple  traditional  issue 
interval  techniques  on  throu^  variations  of  service  life,  failure 
pattern,  distribution  c\irve,  probability,  upper  and  lower  limit, 
actuarial  and  other  approaches. 

INITIAL  VS.  FOLLOW-ON  PREDICTIONS 

No  discussion  of  this  type  would  be  complete  without  some  mention 
of  the  need  for  continuing  the  quest  for  improving  the  initial  pro¬ 
visioning  decisions  which,  especieilly  for  the  crucial  peculiar  items, 
m\ist  be  made  without  benefit  of  experience  or  statistics.  Some  of  the 
points  disc\issed  under  the  topic  of  "Low  Demand  Items"  have  application 
here.  This  is  becoming  an  increasingly  important  etrea,  particularly 
for  "static"  weapons  like  ballistic  missiles  whose  nunibers  are  few, 
whose  life  spans  are  short,  and  whose  operating  time  is  limited.  Thus 
the  initial  buy,  however  small,  frequently  is  the  total  buy.  Though 
we  may  set  up  an  elaborate  system  for  collecting  a  lot  of  data  to 
help  us  with  the  follow-on  buy,  we  may  never  reach  the  point  where 
this  information  will  be  of  much  help  to  us* 

PROGRAM  ELEMENTS 

As  I  mentioned  at  the  conference,  we  here  at  SBAMA  feel  that  one 
fruitful  area  for  further  exploration  is  that  of  program  elements, 
particularly  those  appropriate  for  peculiar  missile  and  spacecraft 
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applications.  The  need  for  some  look  at  this  area  became  quite 
apparent  during  the  conference  vith  discussions  tending  to  gravitate 
around  treiditional  elements  like  aircraft  flying  hours.  Today  in 
the  ballistic  missile  business  we  use  mostly  missile  months,  equipment 
months,  squadron  months,  engine  months,  and  the  engine  overha\il  program. 
But  these  have  been  somewhat  arbitrary  selections  and  perhaps  a  good 
look  is  in  order  now  before  we  find  ourselves  locked  in  on  these  for 
no  better  reason  than  "we*ve  always  done  it  this  way." 

SEASONAL  TYPE  PEAKS 

One  thought  triggered  by  Mr.  Brown’s  presentation:  For  items  that 
tend  to  have  certain  types  of  predictable  peaks,  instead  of  trying  to 
develop  average  rates  that  reflect  these  peaks,  we  would  get  better 
time-phased  answers  if  we  determined  the  average  and  x>eak  require¬ 
ments  separately  and  then  overlaid  the  results. 

PAST  STUDIES  THAT  MIGHT  MERIT  NEW  LOOK 

Perhaps  some  review  and  revitalizing  of  past  findings,  conclusions 
and  recommendations  --  updating  and  reslanting  them  toward  new  modern 
weapons  and  logistics  applications  —  mi^t  in  itself  be  a  fruitfiil 
area  for  future  effort  on  the  peirt  of  research  agencies.  Two  examples 
of  past  RAND  research  come  to  mind  as  x>ossibly  being  worthy  of  some 
new  look  in  light  of  current  conditions  and  needs: 

One  is  the  study  on  "A  Priori  Demand  Prediction"  which 
developed  the  hypothesis  that  physical  and  operational 
characteristics  were  generally  sufficient  to  permit 
classifying  parts  as  hlg^-demand,  low-demand,  or  intermediate- 


demand  items. 
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The  other  is  the  "Flyaway  Kit"  st\xiy.  Perhaps  some  of  the 
principles  in  this  could  be  applied  to  the  provisioning 
and  buy  processes,  with  cost  being  considered  the  constraint 
rather  than  the  wei^t  and  cube  criteria  which  were  more 
appropriate  for  Flyaway  Kits . 

TOE  GROWING  NEED  FOR  UNDERSTANDING  AND  ACCEFTMCE 

In  retrospect,  I  find  myself  wondering  about  the  "follow  throu^" 
aspects  of  research  on  demand  prediction  and  how  well  we  in  the  Air 
Force  (and  perhaps  other  services)  understand  and  are  able  to  apply 
some  of  the  products  of  past  research.  With  research  and  consulting 
agencies  being  concerned  about  where  and  how  they  can  make  further 
contributions  at  this  time,  I  wonder  if  there  isn't  a  considerable 
potential  in  the  area  of  achieving  better  understanding  and  acceptance 
of  their  studies  and  prox)Osals.  At  some  future  conference,  an  exchange 
of  ideas  would  no  doubt  be  beneficial  on  (l)  what  media  the  various 
groups  employ  to  "spread  the  word"  and  gain  acceptance,  and  (2)  how 
effectiveness  in  this  field  can  be  increased. 

I  was  impressed  with  a  remark  Mr.  Dalleck  made  in  this  connection  - 
that  as  a  cons\iLting  firm,  they  try  to  assay  a  company's  technical 
competence  to  carry  on  after  they  leave.  This  woiild  imply  that  they 
either  tailor  their  approaches  and  techniques  accordingly,  or  put 
forth  some  special  effort  to  develop  the  capability  of  their  customer 
to  follow  through  in  the  use  of  the  new  tools. 

Quite  often  the  principles  and  formulae  offered  by  researchers 
and  consultants  need  considerable  "translation”  before  they  can  be 
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understood  and  applied  by  procedures  writers  and  technicians.  Whether 
the  researchers  themselves  or  another  body  of  folks  perform  this 
"translating”  and  stimulating  and  educating  is,  I  supiK>se,  a  matter 
for  debate  —  but  the  gap  m\ist  somehow  be  bridged  if  we  eire  to 
reap  full  benefit  from  the  studies. 

One  company  that,  I  am  told,  devotes  considerable  effort  to 
broadening  understanding  is  the  Planning  Research  Corporation  of 
Los  Angeles  which  does  work  for  the  Navy.  My  understanding  is  that 
they  have  been  quite  active  in  supplementing  their  research  papers 
with  films,  animated  illustrations  of  various  theories  and  concepts, 
training  syllabuses,  and  physical  tools  like  tables,  special  slide 
rules,  hand  calcvilators,  and  the  like.  Thus  many  of  their  products 
are  beamed  directly  to  the  user. 

In  the  case  of  RAND,  we  can  cite  your  Research  Memoranda,  the 
Logistics  Laboratory,  yovoc  scheduled  appearances  at  logistics 
schools,  presentations  at  conferences,  briefings  to  AF  people,  etc., 
as  excellent  means  of  "spreading  the  word."  But  the  audiences  reached 
are  still  no  doubt  relatively  limited.  Perhaps  there  is  a  challenge 
in  trying  to  reach  a  wider  audience  with  more  of  the  basics  and 
fundamentals,  with  more  "why"  and  "how." 
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CONFERENCE  REMARKS 

Kenneth  J.  Arrow 
Stanford  Uhlversity* 

Since  so  much  of  the  Conference  progreun  was  devoted  to  discussion, 
the  following  remrks  cure  Included  to  svmBoarlze  some  of  the  thoughts 
that  came  out  of  the  meeting  as  a  whole.  Our  discussion  was  originally 
oriented  towards  predicting  or  forecasting  demands.  As  we  proceeded, 
however,  our  comments  branched  off  Into  contiguous  matters  for  reasons 
tdiich  are  useful  to  examine. 

THE  PREDICTION  PROBIEM 

Ihere  cure  two  extreme  approaches  to  the  prediction  problem.  One 
Is  a  kind  of  structural  analysis,  in  which  we  try  to  discover  what 
really  causes  demeuids,  and  base  a  predictive  theory  on  o\ir  findings. 

Uie  other  extreme  Is  to  take  a  historical  approach  to  the  process  of 
diange.  We  may  have  no  defensible  theory  to  explain  how  or  why 
demeuids  have  chetnged,  but  we  feel  they  do  not  change  abruptly.  We 
can  get  some  clues  about  the  nature  of  this  change  by  "watching"  the 
situation  closely,  either  In  person  or  through  statistical  technlqties. 
Essentially,  we  extrapolate  backwards  Into  the  peist,  trying  to  Iden¬ 
tify  relevant  trends  and  discard  the  "noise"  (as  It  Is  now  csJJed), 
or  random  dlst\irbeuices  (as  we  used  to  know  It  before  the  conmunlcatlons 
engineers  entered  the  field).  In  real  life,  obviously,  we  eiaploy 
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both  approaches  simultaneously  —  in  the  face  of  numerous  people's 
insistence  that  not  even  the  most  meticulous  of  scrutinies  will 
yield  explanations  or  predictions  any  more  reliable  than  those  of  a 
weatherman. 

Very  little  was  said  at  this  conference  about  tying  in  the  work 
of  the  reliability  engineer  with  that  of  the  demand  forecaster, 
possibly  becavise  we  have  talked  mostly  about  the  military  environment. 
Here  we  deal  with  so  large  a  number  of  items  that  such  integration 
is  difficult  even  though  the  reliability  engineers  may  have  all  kinds 
of  useful  knowledge  about  each  item.  This  Integration  may  or  may  not 
be  worth  pursuing,  but  at  least  it  might  give  us  some  additional 
insights  regarding  structural  possibilities. 

DBHAMD  RATES 

One  interesting  problem  came  out  in  the  casual  discussion  of 
structural  possibilities.  Demand  rates,  according  to  one  report, 
heavily  depend  on  usage;  according  to  another,  apparently  based  on 
similar  data,  they  depend  only  on  elapsed  time.  It  seems  to  be  true 
that  many  pcurts  are  subject  to  an  aging  process,  so  that  we  have  long 
periods  of  low  demand  followed  by  rising  demand  as  the  eqxilpment  ages. 
Bils  is  covintered  by  another  set  of  observations  which  show  tl»t  there 
is  a  "burn-in"  phenomenon;  l.e.,  demands  are  numerous  when  the  equip¬ 
ment  is  relatively  new,  and  decrease  as  the  bugs  are  Ironed  out. 

Biere  is  also  a  point  of  view  based  on  different  data,  which 
suggests  that  the  lisportemt  items  are  those  with  a  very  small  numiber 
of  demands,  say  one  or  two,  over  a  long  period  of  time.  Here  the 
prediction  problem  differs  Aram  the  one  in  idilch  there  Is  a  large 
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number  of  demands.  The  RAND  report  affirms  that  there  are  both 
kinds  of  items,  and  we  may  have  to  treat  them  separately.  Obviously, 
it  is  difficult  to  correlate  a  scattered  handful  of  demands  with  some 
program  element  even  if  there  is  a  correlaticn;  hence  we  would  almost 
never  get  good  estimates  xising  this  type  of  jumlysis.  It  follows 
that  high-dememd  items  offer  greater  possibilities  for  analysis.  On 
the  other  hand,  the  low-demand  problem  is  easier  to  meet  and  solve 
since  the  policies  required  to  handle  it  are  not  dependent  on  any 
program  element. 

STATISTICAL  TORECASTING  TECHNIQUES 

It  is  not  easy  to  form  an  a  priori  opinion  about  the  fruitfulness 
of  statistical  forecasting  techniques.  TMs  needs  to  be  done  empirical¬ 
ly.  In  one  way  or  emother,  most  of  these  methods,  apart  from  spectral 
smalysls,  seem  to  be  of  the  discoxinted  least-squares  type. 

R>r  what  model  of  the  world  would  this  statistical  method  be 
correct  in  euiy  sense?  When  we  consider  that  we  are  getting  a  set 
of  observations  from  virtually  the  same  universe,  why  is  every  obser¬ 
vation  not  as  good  as  any  other  one?  It  is  not  clear  why  one  should 
weight  them  in  any  way. 

The  Interpretation  made  by  Winters  was  that  we  can  think  of  the 
parameters  as  shifting,  but  shifting  in  a  random-walk  aanner,  which 
adds  one  more  unknown.  Looking  ediead,  things  are  getting  more  and 
more  uncertain,  and  discounting  compensates  for  this  growing  unreli¬ 
ability.  By  the  same  token,  if  we  start  tram  the  present  the  past 
data  more  uncez^ln.  TSnis,  if  we  arrived  where  we  are  ziow  by 
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a  random-valk  process,  ve  cem  also  go  backwards  by  the  same  process. 

This  may  be  the  rationalization  for  this  kind  of  least-squares  method. 

Ve  have  a  past  marked  by  chEuige;  ve  think  change  will  persist  as  ve 
go  further  Into  the  future.  !Rie  discounted  least-squares  methods 
coapensate  for  this  process  In  some  way. 

Brown's  eurguments  have  shown  the  flexibility  of  this  model.  One 
can  b\illd  a  great  deal  Into  It,  apparently,  much  more  than  by  straight 
exponential  smoothing.  Furthermore,  It  Is  possible  to  bring  In  any 
explanatory  variables  we  like,  such  as  program  elements  and  eige  of 
parts.  A  combination  of  smoothing  techniques  may  produce  better 
results  with  different  program  elements. 

Another  point  raised  concerned  the  program  elements  themselves. 
Assumlig  that  usage  does  have  established  relationships  to  some  program 
elements,  then  In  order  to  forecast  usage  ve  also  have  to  forecast 
the  program  elements .  Doing  so  Introduces  suldltlonal  "noise . "  Brown ' s 
argument  Is  that  It  Is  better  to  use,  as  explanatory  variables,  mathe¬ 
matical  functions  of  time  about  whose  extrapolation  there  Is  no  question. 

Biere  Is  a  counterargument  which  depends  on  the  use  you  can  make 
of  the  forecast.  A  conditional  forecast  gives  some  Information  that 
sui  unconditional  forecast  does  not.  It  tells  us  what  will  happen  if 
we  change  our  minds,  so  that  we  might  say,  after  looking  at  It,  "It's 
really  too  expensive  to  fly  those  things  aroiand.  I'd  better  not  do  It." 
This  would  make  our  forecasting  worse,  but  It  would  also  answer  a 
question  that  could  not  be  answered  with  an  unconditional  forecast. 

One  could  think  of  other  examples  of  this  kind,  such  as  the  question 
of  checkouts.  How  often  should  ve  perform  checkoixts  If  It  becomes 
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apparent  they  are  a  positive  cause  of  ftiilures?  We  might  try  to  get 
some  idea  of  the  optimum  nmber  of  checkouts.  Probably  ve  vill  not 
reduce  the  number  to  zero^  since  ve  value  the  extra  confidence  more 
checkouts  can  give  us.  We  will  perform  them,  then,  but  want  to  knov 
vhat  they  cost  us  in  terms  of  additional  failures. 

REIATION  TO  INVENTORY  COmOL 

Up  to  this  point  ve  have  talked  about  ways  of  making  forecasts. 
Another  interesting  question  is  how  they  are  to  be  used;  and  another  -- 
perhaps  amounting  to  the  same  thing  —  is  hov  one  can  measure  the 
accuracy  of  his  forecasts.  There  are  many  measures  one  can  use:  the 
average  error,  the  mean  absolute  error,  and  the  relative  error  -  to 
luane  a  few.  The  best  one  to  use  in  a  peurblcular  situation  depends 
on  the  use  to  be  made  of  the  forecasts,  and  the  costs  of  making 
various  kinds  of  forecsists  must  also  be  considered.  Sometiines  the 
cost  may  be  prohibitive. 

Almost  everyone  agrees  that  if  ve  can  make  forecasts  ve  should 
do  so;  but  if  it  tvirns  out  that  ve  cannot,  ve  must  find  a  way  of  doing 
without  them.  IJiere  are  many  alternatives,  one  being  the  control  of 
inventory.  Obviously,  the  more  accurate  our  forecasts,  the  smaller 
the  inventories  we  have  to  hold  (pipeline  considerations  a,side). 
Behavlorlstlcally,  to  say  ve  are  unable  to  forecast  accurately  is  much 
the  same  sis  ssiylng  ve  have  a  very  diffuse  demand  distribution.  There 
is  a  peculiar  difference,  however:  the  demand  distribution  meiy  not 
actually  be  too  diffuse,  but  if  it  cheuiges  from  time  to  time  it  is 
not  even  esisy  to  say  vhat  is  actusaiy  mesmt  by  the  demand  distribution. 
What  is  really  relevant  is  our  subjective  demand  diatributlon  —  one 
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ve  can  reallably  think  of.  It  is  a  blurred  average  of  the  band  of 
possible  demand  distributions  —  even  a  pretty  wide  one.  Anything 
which  is  optimal  against  such  a  wide  distribution  is  liable  to  be  fairly 
unresponsive  to  actual  demand. 

Ignoreuice  costs  something.  It  is  an  unavoidable  cost  and  all 
we  can  do  is  try  to  hedge  against  it.  It  occtirs,  for  example,  in 
the  sampling  inspection  of  lots  of  material :  if  we  do  not  know  whether 
these  lots  are  produced  by  a  controlled  process,  there  eure  sampling 
schemes  which  insure  that  the  percentage  of  defectives  will  not 
exceed  a  specified  value  regardless  of  the  quality  of  the  incoming 
lots.  We  pe^'’  for  this  knowledge,  of  course,  according  to  the  an»unt 
of  inspection  we  institute. 

There  is  an  analogy  here  in  inventory  control.  Presimably  we 
have  better  control  over  our  reliability  data,  however  ixjor  some  of 
our  discussion  implies  they  are,  but  it  does  suggest  the  idea  of  strong 
hedging.  In  practice,  probably  the  simplest  thing  to  do  would  be  err 
on  the  side  of  overstockage .  For  expensive  items,  it  might  pay  to 
subsidize  the  manufactvurer  to  maintain  some  standby  equipment  or 
capacity  to  meet  additional  demauids  on  short  notice.  It  is  costly 
to  do  so,  but  may  be  the  price  we  must  pay  for  lack  of  knowledge.  The 
knowledge-criterion  also  buttresses  a  point  alreeuily  mentioned:  that 
forecasting  techniques  should  be  evaluated  according  to  their  effect 
on  Inventories. 

Now  suppose  we  know  the  underlying  demand  distribution.  In  such 
a  case,  the  meem  is  not  the  only  characteristic  we  would  be  Interested 
in;  ve  voiild  also  be  concerned  with  the  variance.  Our  inventory 
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controls  might  he  set  at,  say,  tvo  standard  deviations  or  vhatever 
number  we  thought  appropriate.  As  Dalleck  pointed  out,  however,  we 
also  have  a  close  Interest  in  the  tails  of  tl»  distribution  and  conse¬ 
quently  medce  things  worse  for  ourselves  since  it  is  very  tricky  to 
estimate  high  percentiles.  Consider  the  problem  of  flood  control. 

Let  us  say  we  want  to  build  a  dam  with  only  a  0.01  probability  of 
not  holding  a  flood;  that  is,  only  once  in  a  hundred  years  (the  return 
period  as  it  is  called)  will  the  flood  exceed  the  dam.  We  cemnot 
make  a  very  accxarate  statistical  estimate  of  the  return  period  for 
a  hundred-year  flood  if  we  have  only  50  or  60  years  of  data;  the  result 
is  very  sensitive  to  the  assumptions  msule  about  the  distribution. 

IJiere  is  much  less  sensitivity  in  an  estimate  of  the  mean.  In  fact, 
the  varieuice  of  the  meeui  is  Independent  of  the  distribution.  When 
we  consider  the  tails,  however,  the  problem  is  more  difficult.  This 
is  probably  why  the  use  of  Tchebycheff 's  inequality  was  suggested;  it 
can  work  in  practice  because  all  the  distributions  we  know  about  are 
well  inside  the  upper  bound  it  provides.  Its  only  drawback  may  be 
that  the  upper  bound  obtained  by  using  it  may  be  too  expensive  for 
the  protection  it  gives  when  we  are  dealing  with  very  expensive  items. 

IRils  discussion  of  tsdls  bolsters  the  argument  that  it  is  as 
Important  to  look  for  protection  as  for  the  other  objectives  of  the 
policies  we  want  to  adopt.  Further,  it  is  for  this  reason  that  even 
if  we  knew  the  distribution  we  would  want  to  consider  more  than  the 
mean.  It  follows  that  if  we  do  not  know  the  distribution  —  euid 
perhaps  decide  to  act  as  if  we  had  a  widely  diffused  one  —  it  becomes 
even  more  iaqportant  to  concern  ourselves  with  the  tails. 
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Suppose  ve  have  a  procediire  for  setting  inventory  levels  based 
on  our  foreceists.  Through  simulation  ve  can  determine  what  the  inven¬ 
tory  vo\ild  have  been  in  each  period,  covinting  back  orders  as  negative 
inventory.  We  can  summarize  the  figures  by  finding  the  average  amount 
of  inventory  on  heuid  fbr  those  periods  for  which  there  was  a  positive 
inventory,  and  the  average  amount  of  back  orders  for  those  periods 
in  which  there  was  not.  These  two  nxmibers  contain  all  the  relevant 
information.  We  can  then  compecre  two  forecasting  methods  by  looking  at 
these  two  numbers  obtained  from  them.  If  both  nvmibers  are  smaller 
for  one  of  the  methods,  then  it  is  clearly  the  better.  ®ie  real 
problem  arises  when  one  method  yields  a  smaller  positive  nuniber, 
the  other  a  smaller  negative;  ve  then  face  the  difficult  task  of 
assigning  explicit  values  to  each  figure. 

A  simple  and  commonly  used  measure  is  the  cost  of  the  item.  This 
solution  implies  ve  would  sooner  take  an  aircraft  out  of  commission 
than  overstock  by  one  peort.  Further,  it  implies  a  different  stockage 
policy  for  each  item.  We  are  assuming  here  that  the  system  is 
rational  in  all  other  respects  —  perhaps  eoi  extreme  assuoptlon,  but 
certainly  a  plausible  one.  Again,  some  items  are  very  expensive  and 
others  very  cheap.  If  we  want  to  economize  on  our  Investment,  it 
would  be  wiser  to  stock  an  abundance  of  cheap  Itene  than  to  have  an 
aircraft  out  of  coomission. 

With  commercial  airlines,  the  loss  in  revenue  when  a  scheduled 
plane  does  not  fly  is  often  less  important  than  the  nuisance  to  the 
customers.  Again,  there  are  some  warehouse  costs.  Interest  on  caplteil 
invested  in  spare  parts,  and  the  like,  which  should  be  considered,  but 
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at  least  ve  vould  have  some  idea  of  the  relative  order  of  magnitude 
of  the  costs. 

AOGREGATION 

The  question  of  aggregating  across  ccamodltles  came  up  several 
times  in  different  contexts  during  the  conference.  When  ve  have 
something  like  two  million  Items,  ve  must  aggregate  because  It  takes 
too  long  to  set  up  em  optimal  inventory  policy  for  each  of  them.  We 
vould  aggregate  in  vide  classes  according  to  the  criterion  of  value, 
although  some  very  e:q>ensive  Items  vould  have  to  be  treated  Individually. 
Ihere  Is  probably  no  partlculsir  advantage  In  being  very  precise  about 
these  values. 

The  second  kind  of  aggregation  Is  through  common  limits.  For 
example,  ve  may  have  a  budget  vhlch  limits  the  total  holdings  of 
Inventory,  so  that  the  more  ve  have  of  one  Item  the  less  ve  can  hold 
of  another.  This  coxistralnt  creates  a  problem  since  ve  may  not  be 
able  to  balance  stockouts  against  holdings,  item  by  Item.  Theoretical¬ 
ly  ve  vould  have  to  put  a  shadov  price  on  the  constraint;  as  a  result, 
the  storage  costs  vould  be  something  different  from  the  plain  calcu¬ 
lated  storage  costs. 

Another  constraint  might  be  cubage,  as  in  a  submarine.  In  such 
a  case  ve  vould  have  to  make  choices  on  a  dlfferoit  basis.  Again  ve 
vould  need  a  shadov  price  for  Ihis  constraint,  but  it  vould  be  dif¬ 
ficult  to  use.  If  ve  could  get  enough  information  ve  might  handle 
the  problem  as  one  of  straightforward  prograiaBing,  but  getting  the 
input  data  vould  be  a  difficulty. 
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A  third  aggregation  procedure,  vhich  came  several  times,  might 
he  called  aggregation  throxigh  borrowed  experience.  This  is  one  of  the 
forecasting  techniques  used  in  the  RAND  study;  the  variance  was  taken 
to  be  three  times  the  mean,  the  number  three  being  derived  from  pooled 
experience.  Brown  and  Vttnters  have  related  the  standard  deviation  to 
the  mean,  apparently  to  get  some  impressions  of  the  variance.  This 
could  also  be  done  by  working  with  a  sample  of  the  conmodlties  and  then 
perhaps  aggregating  or  pooling  the  results.  Actvially  there  is  no  reeison 
in  the  nature  of  things  —  \ailess  for  example  we  know  we  have  a  Poisson 
distribution  —  why  the  standard  deviation  should  be  directly  related 
to  the  mean.  Pooling  presupposes  a  conanonallty  that  has  not  been  demon¬ 
strated. 

A  final  canment,  which  perhaps  should  have  been  made  earlier: 
several  people  seemed  to  agree  that  the  negative  binomial  is  a  good 
description  of  demand,  and  yet  nobody  seems  to  have  used  it,  perhaps 
because  it  is  hard  to  work  with.  The  Poisson,  normal  or  log  normal 
are  more  prevalent. 
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